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PREFACE 


The  present  investigation  was  conducted  at  the  Armstrong 
Laboratory's  Aircrew  Training  Research  Division  to  evaluate  the 
visual  cues  pilots  use  to  determine  target  orientation  in  air-to- 
air  combat  engagements  and  how  accurately  pilots  can  distinguish 
target  orientation.  This  research  effort  was  supported  by  the 
University  of  Dayton  Research  Institute,  Contract  No.  F33615-90-C- 
0005,  in  conjunction  with  Work  Unit  Nos.  2743-25-17,  Flying 
Training  Research  Support,  and  1123-32-03,  Scene  Content 
Requirements  for  Tactical  Simulation.  Contract  Monitor  was  Ms. 
Patricia  A.  Spears.  Work  Unit  Monitor  was  Dr.  Elizabeth  L.  Martin. 

The  authors  wish  to  express  their  c  eepest  appreciation  for  the 
outstanding  services  rendered  in  this  investigation  by  the 
following  individuals:  Dr.  Elizabeth  Martin,  Patricia  Russo,  Marge 
Keslln,  Capt  Gretchen  Anderson,  LtC  James  Anderson,  Todd  Baruch, 
Donald  Fike,  Dr.  Paul  Wetzel,  Norwood  Sisson,  Kathy  Keslin,  and 
Brian  Watkins.  A  special  debt  of  gratitude  is  owed  to  the  U.S.  Air 
Force  personnel  who  served  as  the  points  of  contact,  located  the 
on-site  data  collection  facilities,  scheduled  the  pilots,  and 
willingly  participated  in  the  research. 
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VISUAL  CUE  REQUIREMENTS  FOR  TARGET  ORIENTATION 
ASSESSMENT  IN  AIR  COMBAT  SIMULATION 


INTRODUCTION 

In  alr-to-alr  combat  engagements  that  are  performed  within 
visual  range,  pilots  fly  their  aircraft  at  or  near  the  limits  of 
the  performance  envelope  with  little  or  no  reference  to  Inside 
instruments.  Their  attention  is  initially  focused  outside  the 
cockpit  to  search  for  and  acquire  the  threat  aircraft  in  the  visual 
environment.  The  pilots  must  then  visually  track  and  assess  the 
adversary's  orientation  and  range,  which  dictate  the  tactical 
maneuvers  the  pilots  will  execute. 

Due  to  the  intense  visual  demands  imposed  upon  the  pilots  in 
air-to-air  engagements,  the  effectiveness  of  a  flight  simulator  for 
air  combat  training  will  largely  depend  on  the  characteristics  of 
the  visual  system.  Two  of  the  most  Important  of  these 
characteristics  in  terms  of  air  combat  training  are  display 
resolution  and  the  level  of  target  detail.  Ideally,  the  visual 
system  should  provide  the  visual  cues  pilots  normally  use  in  the 
target  acquisition  and  the  orientation  and  range  assessment  phases 
of  the  engagements  at  the  simulated  distances  corresponding  to 
real-world  training  operations.  If  these  cues  are  not  present  or 
are  not  visible  at  the  correct  simulated  distances,  a  pilot 
practicing  air  combat  maneuvers  will  be  forced  to  approach  the 
simulated  target  aircraft  unrealistically  close,  focus  on 
alternative  visual  cues,  or  omit  the  training  altogether. 

The  visual  cues  and  distances  Involved  in  the  target  detection 
phase  of  air  combat,  as  well  as  the  factors  Influencing  airborne 
target  detection  performance,  have  been  the  subject  of  numerous 
investigations.  The  current  state  of  our  knowledge  concerning  the 
specific  visual  cues  that  are  used  and  the  distances  the  cues  are 
visible  in  the  target  orientation  and  range  assessment  phase  of 
training  is  not  nearly  as  comprehensive,  however.  A  review  of  the 
technical  literature  pertaining  to  airborne  target  acquisition  and 
a. review  of  the  literature  concerned  with  target  orientation  and 
range  assessment  are  provided  below.  Subsequently,  the  gaps  in  our 
knowledge  base  with  respect  to  the  latter  phase  of  air  combat 
simulation  training  are  addressed,  and  the  technical  requirements 
for  the  development  of  realistic  simulation  are  elucidated.  These 
requirements  constitute  the  impetus  for  the  present  investigation. 


Visual  Target  Accmlsition 

The  visual  task  in  the  target  acquisition  phase  of  air-to-air 
engagements  requires  pilots  to  discriminate  the  target  aircraft 
from  the  background.  Of  759  training  engagements  at  the  Naval  Air 
Station  Oceana  Tactical  Air  Combat  Training  System  (TACTS)  range. 


1 


it  was  observed  (Hamilton  &  Monaco,  1986;  Monaco  &  Hamilton,  1985) 
that  pilots  first  sighted  the  target  aircraft  as  a  dot  contrasting 
with  the  background  in  624  engagements  and  that  exhaust  smoke, 
contrails,  and  glint  (i.e.,  sun  reflections)  were  the  first  target 
cues  visible  in  135  engagements.  The  TACTS  is  an  instrumented 
range  where  fighter  aircraft  maneuvers  can  be  trained  and  simulated 
weapons  can  be  fired  and  scored.  Some  of  the  longer  detection 
distances  that  were  obtained  resulted  from  sightings  of  the  smoke, 
contrails,  and  glint.  In  fact,  the  average  detection  distance  for 
the  122  engagements  in  which  exhaust  smoke  was  the  primary  target 
cue  was  7.64  nmi  whereas  the  average  distance  was  5.67  nmi  for  the 
624  engagements  for  which  the  target  first  appeared  as  a 
contrasting  dot. 

Air-to-air  target  detection  distances  were  measured  by  Temme 
and  Still  (1991)  at  the  Naval  Air  Station  Oceana  TACTS  range  to 
compare  detection  performance  between  aviators  who  wore  corrective 
eyeglasses  and  aviators  who  did  not  need  glasses.  The  slant  range 
between  the  pilot  and  the  target  aircraft  was  used  as  the  measure 
of  air-to-air  target  detection  performance,  and  slant  ranges  were 
obtained  from  18  pilots  who  used  eyeglasses  while  flying  and  131 
pilots  who  used  no  glasses.  The  analysis  of  the  data  indicated 
that  the  pilots  with  glasses  detected  the  target  aircraft  on  the 
average  approximately  9.5%  closer  (4.52  versus  4.99  nmi)  than  those 
without  glasses  when  the  slant  ranges  encompassed  all  sightings, 
including  target  glint,  contrails,  and  exhaust  smoke.  This 
difference  was  not  Statistically  significant  (p  >  0.05).  When  the 
slant  ranges  for  aircraft  detection  alone  were  analyzed,  the  mean 
detection  ranges  for  the  pilots  with  glasses  and  the  pilots  without 
glasses  were  respectively  4.35  and  5.05  nmi,  which  were 
significantly  different  (p  <  0.05).  Because  of  the  considerable 
difference  in  group  size,  follow-up  analyses  were  conducted  in 
which  18  pilots  from  the  larger  group  who  did  not  wear  glasses  were 
selected  to  match  the  pilots  who  wore  glasses  in  terms  of  age,  the 
number  of  jet  hours  flown,  and  the  total  number  of  flight  hours. 
Significant  differences  in  detection  distance  were  found  between 
the  two  groups  when  all  sightings  were  compared  and  when  the 
aircraft-only  detections  ware  evaluated  (p  <  0.05).  For  all 
sightings,  the  mean  detection  ranges  were  4.52  and  5.64  nmi  for  the 
pilots  who  wore  glasses  and  the  pilots  who  did  not  wear  glasses, 
respectively;  the  corresponding  distances  were  4.35  and  5.54  nmi 
for  the  aircraft-only  detections. 

Kress  and  Brictson  (1983)  analyzed  87  air-to-air  training 
engagements  conducted  at  the  Yuma  TACTS  range  by  Navy  fighter 
squadrons  from  Naval  Air  Station  Miramar  and  found  that  the  average 
target  detection  distance  when  no  visual  aids  were  used  was  3.1 
nmi.  The  detection  distances  were  collected  from  F-14  and  F-4 
fighter  aircrews,  and  the  targets  were  F-5  and  F-4  aircraft.  When 
visual  aids  were  used  by  the  aircrews,  the  mean  detection  range  was 
nearly  doubled.  The  visual  aids  were  symbols  on  the  aircraft  head- 
up  display  (HUD) ,  which  were  positioned  in  the  HUD  where  the  target 
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was  located  in  the  visual  environment,  and  a  riflescope.  The  mean 
detection  distance  when  the  HUD  symbols  were  used  to  find  the 
target  was  6.8  nmi  and  6.2  nmi  when  the  riflescope  was  employed. 

The  initial  visual  acquisition  distances  in  45  air  combat 
training  engagements  flown  at  the  Air  Combat  Maneuvering  Range 
(ACMR)  were  evaluated  by  Hutchins  (1978) .  He  found  that  the  mean 
visual  acquisition  distance  of  A-4  aircraft  by  F-4  fighter  pilots 
was  3.09  nmi  with  a  range  from  0.38  to  6.23  nmi.  The  ACMR  was  the 
earlier  name  of  the  TACTS. 

Several  Investigators  have  evaluated  the  detection  distances 
of  aircraft  by  ground  observers  to  compare  contrast  sensitivity  and 
visual  acuity  in  relation  to  target  acquisition  performance 
(Ginsburg,  Easterly,  &  Evans,  1983;  O'Neal  &  Miller,  1988)  and  to 
assess  the  effects  of  yellow  ophthalmic  filters  on  target 
acquisition  distance  (Provlnes,  Rahe,  Block,  Pena,  &  Tredici, 
1983).  Ginsburg  et  al.  observed  that  the  mean  detection  distances 
for  an  approaching  T-39  aircraft  by  pilots  ranged  from  0.38  to 
10.26  ml  over  ten  days  of  testing  in  which  the  meteorological 
visibility  conditions  changed  from  0.5  mi  to  over  15  mi.  In  eight 
days  of  testing  in  which  the  weather  varied  from  partly  cloudy  to 
cloudy  with  visibility  conditions  ranging  from  7  to  10  mi,  O'Neal 
and  Miller  found  that  the  detection  distances  for  an  approaching  T- 
38  aircraft  by  ground  observers  ranged  from  4.77  to  6.73  mi. 
Provines  et  al.  obtained  400  visual  acquisitions  of  T-38  aircraft 
approaching  from  a  distance  of  9  ml.  In  half  the  acquisitions,  the 
observers  wore  yellow  ophthalmic  filters;  and  the  other  half  were 
made  without  filters.  There  was  no  statistically  significant 
difference  in  acquisition  performance  associated  with  the  use  of 
the  filters,  and  the  mean  acquisition  distance  for  all  observers 
combined  was  4.55  ml. 

Although  the  target  detection  distances  represent  the  maximum 
visible  distances  of  the  target  aircraft,  it  appears  that  the 
distances  aviators  can  first  detect  target  aircraft  are 
considerably  less  than  the  theoretical  detection  distances.  In  the 
research  mentioned  previously  (Hamilton  &  Monaco,  1986;  Monaco  & 
Hamilton,  1985) ,  it  was  found  that  average  exposed  area  of  the 
targets  at  the  moment  of  detection  was  about  four  times  larger  than 
the  size  predicted  from  the  average  visual  detection  and  high- 
contrast  acuity  thresholds  of  the  pilots  that  were  obtained  in  two 
vision  tests.  The  reduced  detection  distances  observed  in  the 
investigation  were  attributed  to  a  variety  of  environmental, 
vision,  and  flight  performance  factors. 

In  point  of  fact ,  there  is  a  wide  assortment  of  factors  that 
may  influence  target  detection.  Consequently,  to  provide  realistic 
simulation  of  the  actual  training  environment,  the  factors  that  are 
anticipated  in  actual  training  should  be  incorporated  in  the 
simulation.  A  compilation  of  the  factors  that  have  been  found  to 
influence  target  detection  performance  in  both  laboratory  and  field 
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investigations  is  provided  in  Table  1.  These  factors  were 
extracted  from  reviews  of  the  scientific  literature  on  target 
acquisition  performance  (Bloomfield  &  Smith,  1982;  Boff  &  Lincoln, 
1988;  Buffett,  1986;  Costanza,  Stacey,  &  Snyder,  1980;  Hoffmann, 
1976)  and  from  the  field  evaluations  that  were  cited  above. 


Target  Orientation  and  Raiiae  Assessment 

Following  target  acquisition  in  air-to-air  combat  engagements, 
the  pilots  must  continuously  monitor  and  analyze  the  target's 
orientation  and  range  in  order  to  anticipate  the  evolving 
engagement  geometries  and  to  initiate  the  proper  combat  maneuvers. 
Range  is  simply  the  distance  the  two  aircraft  are  separated  from 
each  other,  while  target  orientation  encompasses  the  relative  pitch 
and  bank  attitudes  of  the  target,  as  well  as  the  angular 
relationships  that  exist  between  the  two  aircraft.  In  air  combat 
maneuver ’.ng  within  visual  range,  two  angular  relationships  are  used 
to  specify  the  position  of  one  aircraft  relative  to  the  other: 
aspect  angle  and  heading  crossing  angle  (also  known  as  angle  off). 

Aspect  angle  is  defined  (Brown,  1984;  Department  of  the  Air 
Force,  1986;  Murray,  1987)  as  the  angle  formed  by  the  target's 
flight  path  and  the  line  of  sight  from  the  attacker  to  the  target 
when  measured  from  the  tall  of  the  target  aircraft  (Fig.  1) . 
Aspect  angle  can  vary  from  0  to  180  deg.  For  example,  at  O-deg 
aspect,  the  target  is  tail-o>i  to  the  attacker;  at  180-deg  aspect, 
the  target  is  nose-on  to  the  attacker;  and  at  90-deg  aspect,  the 
long  axis  of  the  target  is  perpendicular  to  the  attacker's  line  of 
sight.  Aspect  angle  changes  as  the  target  changes  heading;  it  is 
not  affected  by  the  attacker's  heading. 

Heading  crossing  angle  is  the  angular  difference  measured 
between  the  longitudinal  axis  of  the  attacker  and  the  longitudinal 
axis  of  the  target  (Fig.  1) .  The  angle  varies  between  0  and  180 
deg,  and  the  angle  changes  when  either  the  attacker  or  the  target 
heading  changes.  The  aspect  angle  and  heading  crossing  angle  are 
equal  whenever  the  attacker  is  pointing  at  the  target. 

The  minimum  distances  pilots  must  be  able  to  visually 
distinguish  the  adversary  aircraft's  orientation  for  various  Basic 
Fighter  Maneuvering  (BFM)  and  Air  Combat  Maneuvering  (ACM)  tasks 
were  determined  by  Brown  (1984)  and  are  provided  in  Table  2.  The 
table  also  specifies  the  distance  requirements  of  the  offensive  BFM 
tasks  that  begin  with  high  aspect  (180  to  135  deg),  medium  aspect 
(135  to  45  deg),  and  low  aspect  (45  to  0  deg)  engagements.  BFM  is 
the  initial  phase  of  air  combat  training  designed  to  develop 
proficiency  in  one-versus-one  aircraft  positioning.  ACM  follows 
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Table  1.  Factors  Governing  Target  Detectability 


Size 

Shape 

Brightness 

Coloring 

Type  of  aircraft 

Location  in  the  visual  field 

Motion 

E^gposure  time 

Smoke 

Contrails 

Glint 

Dynamics 

Target-to-background  contrast 

Environmental  characteristics 
Background  brightness 

Atmospheric  conditions,  i.e.,  haze,  smoke,  dust 

Cloud  cover 

Sun  position 

B^  ;:;kground  clutter 

Glare 

Cockpit  structures 

Observer  characteristics 
Visual  acuity 
Accommodation  and  myopia 
Contrast  sensitivity 
Workload 
Eye  movements 
Search/ scan  patterns 

Miscellaneous  factors,  l.e.,  motivation,  fatigue, 
anxiety,  anticipation 
Training 

Individual  differences 


Dynamics 

Cockpit  physical  structures 


Target  and  observer  aircraft  relationships 
Slant  range 
Target  orientation 
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Figure  1 

Geometrical  Relationships  Between  Target  and  Attacker  Aircraft 


Table  2 .  Aircraft  Orientation  Assessment  Distances  for  EFM 
and  ACM  Tasks  (from  Brown,  1984) 


Task  Maneuver 

Distance  (ft) 

Neutral  BFM 

Two  circle 

15,000 

17,000 

One  circle 

9,000 

- 

11,000 

Olfengjyg-BEM 

High  ■■^gp.ggt 

Immelmann 

10,500 

13,000 

Mgdigw, aspect 

Barrel  roll 

10,500 

- 

12,000 

High  Yo-Yo 

4,500 

- 

5,500 

Vector  roll 

4,000 

- 

5,000 

Low  Yo-Yo 

3,500 

mm 

5,000 

Quarter  plane 

2,500 

— 

3,500 

Low  aspect 

High  Yo-Yo 

3,000 

- 

4,000 

Vector  roll 

3,500 

- 

4,500 

Low  Yo-Yo 

3,000 

- 

4,000 

Lag  roll 

2,500 

- 

3,500 

Quarter  plane 

2,000 

- 

3,000 

Gun  tracking 

1,500 

- 

2,500 

Gun  snap  shots 

4,000 

- 

5,500 

Missile  attacks 

6,500 

- 

8,000 

Counteroffensive  BFM 

Hard  turns 

9,000 

10,000 

Counter  to  Yo-Yo 's 

5,000 

mm 

7,000 

Break  turns 

6,000 

- 

7,500 

Reversals/Scissors 

2,500 

- 

3,000 

High-g/Angle-of -Attack  rolls 

2,000 

- 

3,000 

Guns  defense 

2,000 

— 

2,500 

aCtenglYV  ACM 

Co-Flow  entries 

13,000 

18,000 

Counter-Flow  entries 

13,000 

mm 

18,000 

High/Low  entries 

9,000 

- 

11,000 

Cover  wing 

8,000 

- 

9,000 

Fighting  wing 

2,000 

- 

3,000 

Counteroffensive  ACM 

Counters  to  switch  attacks 

10,000 

14,000 

Element  sandwich 

9,000 

• 

10,000 
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the  BFH  phase  of  fighter  aircraft  training  and  encompasses  the 
coordinated  application  of  BFH  by  two  or  more  aircraft  to  deliver 
ordnance  against  one  or  more  target  aircraft.  The  distances 
reported  by  Brown  were  extracted  from  Air  Combat  Maneuvering 
Instmimentation  (ACMI)  range  data  for  F-15,  F-4,  and  F-5  fighter 
aircraft.  The  ACMI  is  the  Air  Force  equivalent  of  the  Navy's 
TACTS. 


In  a  previous  experiment.  Coward  and  Rupp  (1982)  investigated 
the  visual  cues  pilots  use  in  real-world,  air-to-air  combat 
training.  The  participants  were  15  F-4  fighter  pilots  who  had 
completed  BFH  and  ACM  training,  and  a  questionnaire  was  used  to 
solicit  the  visual  cues  the  pilots  used.  The  cues  that  were 
indicated  and  the  percentage  of  pilots  mentioning  each  of  the  cues 
are  provided  in  Table  3 .  It  may  be  seen  in  the  table  that  the  cues 
most  frequently  used  to  determine  target  position  were  wing 
planform,  target  nose  position,  relative  motion  across  the 
attacker's  canopy,  and  relative  size/size  changes^ 


Problem  Statement 

As  the  pilot  maneuvers  in  air-to-air  combat  engagements  to 
either  attack  or  evade  the  adversary  aircraft,  the  physical 
features  of  the  adversary  that  are  visible  to  the  pilot  are 
constantly  changing.  At  any  given  moment,  a  variety  of  cues  is  in 
view,  which  the  pilot  uses  to  assess  the  adversary's  spatial 
orientation  and  range.  Although  Brown  (1984)  specified  the  minimum 
distances  at  which  the  pilot  must  be  able  to  determine  target 
aircraft  orientation,  the  visual  cues  that  must  be  visible  at  these 
distances  and  orientations  were  not  addressed.  Coward  and  Rupp 
(1982) ,  on  the  other  hand,  identified  the  array  of  cues  that  pilots 
use  in  real-world  air  combat  training  but  not  the  distances  at 
which  the  cues  must  be  discernible.  As  a  result,  the  target  cues 
that  must  be  dlscrlminable  at  different  distances  for  different 
target  orientations  are  unknown.  Because  this  Inforaatlon  is 
essential  to  the  development  of  visual  simulation  systems  for  air 
combat  training,  an  investigation  was  conducted  that  focused  on  the 
visual  cue  requirements  for  target  orientation  assessment.  The 
investigation  that  was  accomplished  is  presented  herein. 


Purpose  and  Scope 

The  primary  objectives  of  this  Investigation  were  to  evaluate 
the  visual  cues  pilots  use  and  the  distances  the  cues  are 
discernible  in  the  target  orientation  and  range  assessment  phase  of 
air-tc-air  combat  engagements.  The  results  will  have  application 
in  the  determination  of  the  display  resolution  and  the  level  of 
image  detail  requirements  for  flight  simulator  training.  In  the 
investigation,  U.S.  Air  Force  fighter  pilots  were  asked  to  Indicate 
the  orientations  of  static  target  aircraft  images,  then  to  specify 
the  visual  cues  they  used  to  determine  the  orientations.  The 
variables  that  were  manipulated  were:  target  orientation,  target 
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Table  3.  Visual  Cues  Used  In  Air-to-Alr  Combat  Training 
(from  Coward  &  Rupp,  1982) 


Cues  reported 

Percent  of  subjects 

Vital  Important  Desirable 

Relative  motion— on  canopy 

73.3 

6.7 

Relative  motion — to  outside  ref.  point 

33.3 

6.7 

6.7 

Wing  planform 

93.3 

6.7 

— 

Target  nose  position 

80.0 

— 

~ 

Relative  slze/slze  changes 

53.3 

6.7 

~ 

Sun  glint 

6.7 

26.7 

13.3 

Smoke 

20.0 

26.7 

33.3 

Afterburner  plume 

13.3 

13.3 

46.7 

Wingtip  contrails 

~  ' 

20.0 

40.0 

High  altitude  contrails 

6.7 

20.0 

20.0 

Altitude  cues 

-- 

13.3 

~ 

Weapon  cues  (missile  plume  etc.) 

6.7 

6.7 

— 

Color 

13.3 

13.3 

20.0 

Shading  and  shadows 

6.7 

6.7 

6.7 

Yaw  movement 

6.7 

— 

Distinction  of  top  vs.  bottom 

6.7 

■  ~  ' 

— 

Control  surface  movements 

6.7 

— 

-- 

Vertical  position 

6.7 

Shape  (for  target  identification) 

6.7 

— 

— 

Fine  target  detail 

— 

6.7 

6.7 

Ground  cues 

13.3 

type,  target  distance,  pilot  flight  experience,  and  whether  the 
pilots  viewed  the  same  or  different  target  aircraft  from  their  own 
aircraft.  In  addition,  the  responses  were  analyzed  to  evaluate  the 
effects  of  the  test  conditions  on  target  orientation  recognition 
accuracy. 


METHOD 


A  total  of  80  U.S.  Air  Force  active  duty  and  reserve  fighter 
pilots  participated.  The  pilots  consisted  of  20  instructor  pilots 
(IPs) ,  20  TX/C>Course  pilots,  20  B-Course  pilots,  and  20 
operational  pilots.  Table  4  indicates  the  current  aircraft  of  the 
pilots  in  each  group,  the  average  number  of  flight  hours  in  the 
current  aircraft,  the  average  number  of  total  fighter  flight  hours. 
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Table  4.  Pilot  Flight  Experience 


Pilots 

No. 

_ SBrrgiit  j^/c _ 

F-15  F-16  A-7 

Avg  current 
aircraft  hrs 

Avg  total 
aircraft  hrs 

TVvg  A/A 
sorties 

IPs 

20 

10 

9 

1 

635.5 

2146.0 

65.7 

TX/C 

20 

10 

6 

4 

132.5 

1957.6 

53.3 

B 

20 

7 

9 

4 

50.9 

505.2 

19.2 

OPS 

20 

10 

10 

■I 

272.4 

802.0 

61.2 

and  the  average  number  of  air-to-air  training  sorties  accomplished 
in  the  12  months  prior  to  the  test.  The  air-to-air  training 
sorties  included  BFH,  ACM,  air  combat  training  (ACT) ,  dissimilar 
air  combat  training  (DACT) ,  Composite  force  training  (CFT) ,  and  Red 
Flag  sorties.  The  pilots  Were  from  the  405th  Tactical  Training 
Wing  and  58th  Tactical  Training  Wing,  Luke  Air  Force  Base,  AZ;  the 
49th  Tactical  Fighter  Wing,  Holloman  Air  Force  Base,  NM;  the  388th 
Tactical  Fighter  Wing,  Hill  Air  Force  Base,  DT;  and  the  I62nd 
Tactical  Fighter  Group,  Tucson,  AZ.  If  the  pilots  normally  used 
eyeglasses  or  contact  lense^  when  flying,  they  were  asked  to  wear 
them  during  testing.  I 


Visyal  gtiinuli  | 

The  visual  stimuli  weij’e  photographic  slide  images  of  1/48- 
scale,  F-15  and  F-16  aircrafit  models.  A  separate  set  of  slides  was 
produced  for  each  model  consisting  of  8  demonstration  slides,  8 
practice  slides,  and  64  test  slides.  The  spatial  orientations  of 
the  models  depicted  in  the  Itest  slides  are  presented  in  Table  5. 
Four  images  were  produced  for  each  aircraft  orientation  to  simulate 
distances  of  0.5,  1.0,  2.0,  and  3.0  nmi.  The  factorial  combination 
of  the  16  orientations  and  four  distances  provided  the  64  test 
slides.  The  same  orientations  and  distances  were  used  for  both  the 
F-15  and  F-16  slide  sets.  The  rationale  for  using  these  four 
distances  is  that  they  are  representative  of  the  distances  involved 
in  the  target  orientation  and  assessment  phase  of  air  combat 
training  as  specified  by  Brown  (1984)  and  shown  in  Table  2. 

For  the  sake  of  clarification,  the  aspect  angles  and 
directions  of  travel  employed  in  the  present  investigation  are 
illustrated  in  Figure  2.  The  heading  crossing  angle  was  always 
equal  to  the  aspect  angle  (see  definition  of  aspect  angle  and 
heading  crossing  angle  above) . 
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Table  5.  Target  Orientations 


Target 

orientation 

Aspect  angle 
(deg) 

Direction 
of  travel 

Pitch  angle 
(deg) 

Bank  angle 
(deg) 

1 

0 

Tail-on 

0 

0 

2 

0 

Tail-on 

45  Up 

0 

3 

180 

Nose-on 

0 

0 

4 

180 

Nose-on 

45  Up 

0 

5 

90 

Left 

45  Down 

0 

6 

90 

Left 

0 

60  Left 

7 

90 

Right 

0 

60  Left 

8 

90 

Right 

45  Up 

120  Left 

9 

45 

Left 

0 

45  Left 

10 

45 

Left 

45  Down 

0 

11 

135 

Left 

45  Up 

45  Right 

12 

135 

Left 

0 

45  Left 

13 

45 

Right 

0 

45  Left 

14 

45 

Right 

45  Down 

45  Right 

15 

135 

Right 

0 

0 

16 

135 

Right 

45  Down 

0  . 

Guidance  was  obtained  from  a  U.S.  Air  Force  fighter  pilot  in 
the  selection  of  the  target  orientations.  Each  of  the  aspect  angle 
and  direction  of  travel  combinations  was  used  twice  in  the  16 
target  orientations.  Additionally,  the  nxunber  of  pitched  targets 
was  the  same  as  the  number  of  ncnpitched  targets  and  the  number  of 
banked  targets  was  equal  to  the  number  of  nonbanked  targets.  A 
photograph  of  each  of  the  16  target  orientations  at  0.5  nmi  is 
provided  in  Appendix  A.  ' 

Each  of the  eight  combined  aspect  angles  and  directions  of 
travel  employed  in  the  test  slides  was  presented  in  both  the 
demonstration  slides  and  the  practice  slides,  and  they  were 
randomly  combined  with  various  pitch  and  bank  angles.  Also,  two  of 
the  target  orientations  in  both  slide  sets  were  randomly  combined 
with  each  of  the  four  simulated  distances  that  were  used  in  the 
test  slides.  None  of  the  combinations  of  orientations  and 
distances  used  in  the  demonstration  and  practice  slides  were  the 
same  as  the  combinations  presented  in  the  test  slides. 

The  aircraft  models  used  for  the  slides  were  assembled  from 
commercially  available  kits,  and  the  model  paints  were  applied  with 
an  airbrush.  Standard  U.S.  Air  Force  camouflage-gray,  F-IS  and  F- 
16  color  schemes  were  adopted.  Both  models  were  equipped  with 
missiles,  which  were  painted  white.  The  F-16  was  modeled  with  two 
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AIM-9  missiles,  and  the  F-15  was  equipped  with  four  AIM-7  missiles 
and  four  AIM-9  missiles.  Neither  model  had  external  fuel  tanks  nor 
landing  gear. 

The  slides  were  taken  in  a  studio  using  a  35mm  single-lens 
reflex  (SLR)  camera  with  Kodachrome  25  color  film.  The  models  were 
suspended  on  lightweight  monofilament  fishing  line,  and  a  white 
background  was  used  to  simulate  atmospheric  haze  or  clouds. 
Several  strobe  lights  were  used  to  illuminate  the  aircraft  models 
and  the  background.  The  camera  was  always  level  with  the  models 
and  focused  on  the  aircraft  fuselage,  midway  between  the  nose  and 
tail.  The  specific  target  orientations  depicted  in  the  slides  were 
achieved  by  adjusting  the  position  of  the  model,  and  the  required 
distances  were  simulated  by  photographing  the  models  at  four 
discrete  distances  in  the  studio. 


Apparatus 

The  stimuli  were  presented  on  an  18  in.  by  18  in.  rear- 
projection  screen  using  a  Gerbrands  Corporation  G1178  3-Field 
Projection  Tachlstoscope.  The  tachlstoscope  employed  three  Kodak 
Ektagraphic  Model  IIIB  carousel  projectors,  three  tachistoscopic 
shutters,  a  formica  base,  two  beam  splitters,  a  shutter  drive 
control  console,  and  a  tachlstoscope  controller.  The  spatial 
relationships  between  the  observer,  projection  screen,  and  slide 
projectors  are  illustrated  in  Figure  3. 

Because  of  the  distances  at  which  the  aircraft  models  were 
photographed,  portions  of  the  studio  were  unavoidably  visible  in 
the  original  slides.  These  unwanted  features  were  eliminated  with 
slide  masks  that  were  sandwiched  in  the  slide  mounts.  The  slide 
masks  were  transparent  in  the  center  and  opaque  in  the  periphery. 
Slide  projector  1  in  Figure  3  was  used  to  present  the  aircraft 
images  with  the  slide  masks.  To  compensate  for  the  reduction  of 
the  slide  field  of  view  from  the  masks,  an  equal  number  of  slides 
of  the  aircraft  background  were  produced  with  opposite  masks,  which 
were  presented  simultaneously  with  the  aircraft  images.  These 
slides  were  presented  using  projector  2.  The  masks  for  the 
background  were  opaque  in  the  center  and  transparent  in  the 
periphery,  and  the  background  completely  filled  the  slide  "window." 
Slide  projector  3  was  used  to  present  an  unmasked  background  image 
that  provided  constant  screen  illumination  in  the  interval 
following  the  presentation  of  the  stimuli.  The  shutter  drive 
control  console  powered  the  projector  shutters,  and  the  duration 
and  sequence  of  the  shutter  openings  were  controlled  by  the 
tachlstoscope  controller.  The  projectors  were  placed  on  the 
formica  base,  and  the  beam  splitters  were  arranged  as  depicted  in 
Figure  3. 
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A  pilot  control  console  was  provided  that  contained  two 
precision  telegraph  keys.  One  key  was  used  to  concurrently  trigger 
the  tachistoscope  controller  and  activate  a  digital  timer,  while 
the  other  key  was  used  to  stop  the  timer. 

When  the  tachistoscope  controller  was  triggered,  the  stimulus 
slides  (i.e.,  an  aircraft  slide  and  the  corresponding  background 
slide)  were  simultaneously  presented,  the  timer  started,  and  the 
unmasked  background  slide  was  blanked.  After  5  s  had  elapsed,  the 
stimulus  slides  were  blanked  and  the  unmasked  background  slide  was 
displayed  until  the  tachistoscope  controller  was  triggered  again. 

The  tachistoscope  controller  was  also  used  to  activate  a 
Gerbrands  Corporation  G1180A  Slide  Changer,  which  advanced  the 
slides  of  the  aircraft  and  corresponding  background  images.  The 
slide  changer  was  triggered  immediately  after  the  5-s  stimulus 
interval.  The  unmasked  background  slide  image  was  not  changed. 

During  data  collection,  the  pilots  were  seated  at  a  pilot 
station,  which  included  a  table,  a  chin  rest,  a  standard  office 
chair,  and  the  pilot  control  console.  The  chin  rest  was  adjusted 
so  that  the  pilots'  eyes  were  level  with  aircraft  images  on  the 
screen.  The  viewing  distance  from  the  eye  position  to  the  screen 
was  12  ft. 


Experimental  Design 

A  five-factor  experimental  design  was  used,  which  consisted  of 
three  between-subject  factors  and  two  wi thin-subject  factors.  The 
between-subject  factors  were  (a)  pilot  type,  (b)  target  type,  and 
(c)  pilot's  aircraft;  and  the  wi thin-subject  factors  were  (a) 
target  orientation  and  (b)  target  distance.  The  levels  associated 
with  each  factor  are  specified  in  Table  6.  Under  the  pilot's 
aircraft  factor  in  the  table,  "same**  means  that  the  pilots  were 
current  in  the  same  aircraft  as  the  target  type  they  were 
presented,  and  "different"  indicates  that  the  pilots  were  current 
in  an  aircraft  that  was  different  from  the  type  of  targets  they 
viewed.  _ 


Procedure 

Data  collection  was  accomplished  on  site  at  Luke  Air  Force 
Base,  AZ;  Holloman  Air  Force  Base,  NM;  Hill  Air  Force  Base,  UT;  and 
the  Arizona  Air  National  Guard,  Tucson,  AZ.  The  equipment  was 
transported  to  each  of  the  test  sites,  and  the  data  weie  collected 
in  a  semidarkened  private  room.  A  test  schedule  was  initially 
established  at  each  of  the  sites  visited,  and  then  squadron 
personnel  randomly  *  assigned  pilots  to  participate .  in  the 
investigation  from  among  those  who  were  available  at  the  scheduled 
times.  The  pilots  were  tested  individually,  and  they  were  randomly 
assigned  either  the  F-15  or  F-16  target  sets.  Each  session  lasted 
between  45  and  75  min. 
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Ten  operational  F-IS  pilots  were  used  at  Holloman  Air  Force 
Base  and  ten  operational  F-ie  pilots  were  used  at  Hill  Air  Force 
Base.  Half  of  the  pilots  at  each  location  viewed  the  F-15  slide 
set  and  half  viewed  the  F-16  set.  The  instructor  pilots,  TX/C- 
Course  pilots,  and  B-Course  pilots  were  obtained  from  Luke  Air 
Force  Base  and  the  Arizona  Air  National  Guard,  and  the  pilots  were 
tested  in  random  order. 

Prior  to  the  start  of  the  slide  presentations,  the  pilots  were 
provided  a  standard  set  of  instructions,  which  described  the 
purpose  and  scope  of  the  research,  the  visual  stimuli  and  target 
orientations,  the  pilot's  task,  and  the  procedures.  The  eight 
demonstration  slides  were  then  presented.  The  experimenter 
identified  the  aspect  angle,  direction  of  travel,  pitch,  bank,  and 
simulated  distance  of  the  targets  in  each  slide,  as  well  as  the 
salient  visual  cues,  using  the  corresponding  aircraft  model.  The 
slide  exposures  were  controlled  by  the  experimenter,  and  they  were 
displayed  until  the  pilot  had  assimilated  the  image. 

The  pilots  were  then  presented  the  8  practice  slides  and  the 
64  test  slides,  and  both  the  practice  and  test  trials  were  pilot- 
I  paced.  When  the  pilots  were  ready  to  View  a  slide,  they  pressed 
I  the  key  on  the  pilot  control  console  that  triggered  the 
tachistcscope  and  the  digital  timer.  After  the  pilots  had 
j determined  the  orientation  of  the  target  in  the  slide,  they  first 
I  pressed  the  key  on  the  control  console  to  stop  the  clock  and  then 
^they  indicated  the  aspect  angle,  direction  of  travel,  pitch 
attitude,  and  bank  attitude  of  the  aircraft  and  the  visual  cues 
they  used  on  a  response  form.  Feedback  concerning  the  target 
I  orientation  was  provided  for  the  practice  slides. 

The  response  form  consisted  of  a  nine-page  booklet,  one  page 
for  the  practice  slides  and  eight  pages  for  the  test  slides.  The 
slides  were  niunbered  sequentially  on  the  pages,  and  there  were 
eight  slides  to  a  page.  For  each  slide,  all  eight  combined  aspect 
angles  and  directions  of  travel  were  listed,  three  response 
alternatives  were  provided  for  pitch  attitude  (i.e.,  high,  level, 
and  low) ,  three  response  alternatives  were  provided  for  bank 
attitude  (i.e.,  left,  zero,  and  right),  and  space  was  provided  for 
specifying  the  visual  cues.  The  pilots  were  asked  to  circle  the 
target  conditions  they  felt  were  depicted  on  the  screen. 

The  order  in  which  the  test  slides  were  presented  was  fully 
randomized,  and  a  different  random  sequence  was  used  for  each  of 
the  pilots.  The  practice  and  test  slides  were  each  presented  for 
5  s,  and  the  pilots  were  requested  to  use  the  chin  rest  when  they 
viewed  the  slides.  The  pilots  were  instructed  to  respond  as 
rapidly  as  possible  but  that  accuracy  was  more  important  than 
speed.  Prior  to  each  session,  the  pilot  was  administered  a  pilot 
experience  form;  and  following  the  session,  a  debriefing 
questionnaire  was  administered.  Each  morning  before  the  first 
pilot  arrived,  the  equipment  setup  was  calibrated. 

17 


/ 

/ 

iL 


The  response  time  data  were  collected  to  permit  the 
experimenters  to  ascertain  whether  the  duration  of  the  slide 
exposures  was  adequate.  Because  the  response  time  data  were  not 
critical  to  the  objectives  of  the  investigation,  they  were  not 
subjected  to  statistical  analysis. 


RESULTS 

Visual  Cue  Usage 

The  visual  cues  the  pilots  indicated  they  used  in  conjunction 
with  each  of  the  16  target  orientations  are  summarized  in  Table  7. 
Each  orientation  encompasses  the  various  target  types,  target 
distances,  and  types  of  pilots.  The  specific  cues  used  with  the 
two  target  types  (i.e.,  F-15  and  F-16  targets)  at  the  four 
simulated  distances  are  provided  in  Appendix  B  for  each  of  the  16 
target  orientations.  The  data  arrayed  in  the  tables  represent  the 
percentage  of  the  total  number  of  correct  target  orientation 
responses  in  which  the  target  cue  was  specified  by  the  pilots.  A 
correct  target  orientation  response  in  the  present  context  is 
defined  as  a  correct  aspect  angle,  direction  of  travel,  pitch,  and 
bank  response.  In  some  instances,  the  pilots  provided  more  than 
one  target  cue  for  a  target  presentation,  thus  the  column  totals 
may  exceed  100  percent.  "No  response"  in  the  table  signifies  that 
the  pilots  did  not  specify  any  target  cues,  even  though  they 
correctly  identified  the  target  orientation. 

The  analyses  of  the  target  orientation  responses,  which  are 
addressed  in  the  following  section,  indicated  that  the  differences 
in  response  accuracy  between  pilot  types  was  negligible  and  that 
there  was  no  effect  of  pilot's  aircraft  type  on  the  response 
accuracy  when  the  16  target  orientations  were  pooled. 
Consequently,  the  specific  visual  cues  used  in  conjunction  with  the 
four  pilot  types  and  pilot's  aircraft  type  were  not  tabulated. 

In  constructing  Table  7  and  the  tables  in  Appendix  B,  all 
tail-related  responses  were  combined  within  the  "tail"  target  cue. 
These  responses  included:  rudder,  vertical  stabilizer,  stabilator, 
horizontal  tail,  tail  fin(s),  space  between  tails,  and  just  tall. 
Conversely,  "no  tall"  includes:  no  rudder,  no  stabilizer,  no 
fin(s),  no  space  between  tails,  and  no  tail.  The  cue  "top  of 
aircraft/wings"  represents  the  combination  of  three  responses:  top, 
top  of  aircraft,  and  top  of  wings.  "Entire  aircraft"  means  that 
the  target  was  so  large  on  the  screen  that  an  array  of  cues  too 
numerous  to  elucidate  were  simultaneously  distinguishable. 
"Planform"  and  "silhouette"  could  have,  possibly,  been  combined  in 
the  tables.  Strictly  speaking,  the  term  silhouette  refers  to  the 
outline  or  contour,  whereas  planform  refers  to  the  outline  of  an 
aircraft  when  looking  at  it  such  that  the  wing  shape  is 
distinguishable.  "No  planform"  indicates  the  wing  contour  was  not 
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Table  7.  Summary  of  Target  Cues  Used  In  Relation 
to  16  Target  Orientations 


_ Target  orientation _ 

No. 

Target  cue 

1 

2 

3 

4 

5 

6 

7 

8 

1 

Tall 

21.0 

23.4 

17.6 

15.3 

51.4 

26.7 

14.8 

21.1 

2 

Wings 

17.5 

20.6 

13.8 

17.5 

11.9 

28.5 

21.2 

15.6 

3 

Nose 

2.8 

23.4 

11.4 

22.4 

30.0 

22.7 

12.8 

19.3 

4 

Intake (s) 

3.5 

1.6 

47.6 

fO.8 

8.3 

1.1 

29.6 

23.9 

5 

Planform 

- 

31.5 

«■ 

13.7 

21.0 

29.2 

19.7 

23.9 

6 

Canopy 

5.6 

23.0 

10.5 

- 

7.1 

32.5 

0.5 

- 

7 

Belly 

- 

0.4 

- 

27.3 

- 

- 

29.6 

29.4 

8 

Missiles 

- 

- 

- 

16.4 

5.5 

0.7 

26.1 

32.1 

9 

Top  of  aircraft/ 
wings 

22.6 

C.6 

18.4 

0.5 

0.9 

10 

Fuselage 

2.8 

13.2 

2.9 

6.0 

19.0 

13.0 

7.9 

6.4 

11 

Exhaust  outlet (s) 40.6 

5.9 

0.5 

- 

0.4 

0.7 

1.0 

0.9 

12 

Entire  aircraft 

- 

2.0 

1.4 

1.1 

1.6 

4.0 

4.4 

0.9 

13 

Silhouette 

11.2 

- 

14.8 

- 

- 

- 

- 

“ 

14 

No  planform 

7.0 

- 

6.7 

- 

9.1 

— 

- 

- 

15 

No  wings 

- 

- 

- 

15.0 

tm 

“ 

16 

No  tail 

0.7 

2.0 

1.4 

4.4 

2.4 

0.4 

3.5 

3.7 

17 

No  intake (s) 

1.4 

5.1 

- 

- 

2.0 

2.5 

1.0 

1.8 

18 

Color 

1.4 

2.3 

in 

• 

o 

2.2 

- 

1.8 

2.0 

2.8 

19 

No  missiles 

- 

2.7 

- 

- 

- 

1.8 

- 

- 

20 

Dark  dot 

4.2 

- 

3.3 

- 

- 

- 

- 

21 

No  canopy 

0.7 

0.8 

- 

- 

- 

- 

1.5 

2.8 

22 

Strakes 

1.4 

«r 

- 

mt 

0.4 

- 

2.0 

0.9 

23 

Side  view 

- 

- 

- 

-■ 

4.4 

1.1 

- 

- 

24 

No  exhaust 
outlet (s) 

in 

• 

o 

1.2 

1.4 

1.5 

0.9 

25 

Aircraft  size 

- 

- 

- 

0.6 

- 

- 

- 

26 

No  fuselage 
length 

4.2 

1.4 

27 

No  nose 

1.4 

— 

1.9 

0.6 

— 

— 

— 

— 

28 

Cockpit 

- 

- 

mm 

- 

- 

1.1 

- 

- 

29 

No  shadows 

* 

— 

— 

0.4 

— 

— 

— 

30 

No  exhaust  outlet 
metal 

0.4 

tm 

31 

No  strakes 

- 

0.4 

- 

- 

tm 

- 

- 

- 

32 

No  response 

17.5 

7.4 

16.7 

6.6 

4.0 

4.3 

5.4 

6.4 

Notes.  1. 

2. 

3. 


Data  represent  percent  of  correct  responses  each  cue  was 
used. 

Dash  indicates  cue  was  not  used. 

"No  response"  signifies  that  the  pilots  did  not  specify 
any  cues. 
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visible,  although  the  silhouette  definitely  was.  When  "no  vliig" 
was  indicated,  the  wing  was  observed  to  be  level  with  the  fuselage, 
and  its  shape  was  not  discernible.  Whilb  "intake(s)"  primarily 
refers  to  the  intake  opening(s) ,  occasionally  the  pilots  used  it  in 
reference  to  the  bulge  below  the  fuselage  on  the  F- 16  targets  or  on 
either  side  of  the  F-15  targets.  That  is  why  this  cue  was 
specified  when  the  target  was  pointed  away  from  the  pilot  and  the 
intake  opening  was  obviously  not  distinguishable.  The  remaining 
target  cues  are  self-explanatory. 


Response  Accuracy 

A  series  of  statistical  analyses  was  conducted  to  evaluate  the 
effects  of  the  various  test  conditions  on  response  accuracy.  A 
logistic  analysis  was  used  since  the  responses  were  dichotomous, 
i.e.,  correct  or  incorrect.  This  analysis  provides  the  same  type 
of  information  as  an  analysis  of  variance  (ANOVA)  without  the 
normality  assumption.  The  test  statistic  is  the  chi-squire  (x^) . 
For  more  detailed  information  concerning  logistic  analyses,  refer 
to  Fienberg  (1980) . 

Separate  statistical  analyses  were  performed  to  compare 
different  combinations  of  treatment  conditions  and  different  types 
of  scores.  Fifteen  analyses  were  run.  In  the  first  five  analyses, 
various  slide  conditions  were  pooled  to  form  the  various  levels  of 
the  treatment  conditions.  In  the  following  10  analyses,  specific 
target  orientations  were  compared  to  assess  the  differences  in 
target  aspect,  direction  of  travel,  pitch,  or  bank  on  recognition 
accuracy.  The  analyses  that  were  accomplished  and  the  results  of 
the  analyses  are  described  along  with  the  treatment  conditions  and 
scores  that  were  employed  in  each  analysis. 

Response  Accuracy  as  a  Function  of  Target  Type.  Target 
Distance.  Pilot  Type,  and  Pilot^s  Aircraft  Type.  Four  experimental 
conditions  were  compared  in  the  initial  analysis  using  a  four- 
factor  model.  The  If actors  were:  target  type,  target  distance, 
pilot  type,  and  pilot's  aircraft  type.  In  this  analysis,  the 
response  data  were  summed  across  the  16  target  orientations.  A 
correct  response  fori  a  particular  target  presentation  was  defined 
as  a  correct  aspect  angle,  direction  of  travel,  pitch  attitude,  and 
bank  attitude  response.  If  any  individual  response  was  incorrect, 
the  overall  response  \ was  Incorrect. 

The  analysis  indicated  that  the  main  effect  of  target  type  was 
statistically  signifibant  (x*(l)  =  173.78,  p  <  0.01),  as  were  the 
main  effects  of  target!  distance  (x*(3)  =  449.48,  p  <  0.01)  and  pilot 
type  (x^/3)  *  14.96,  p  <  0.01).  In  addition,  two  two-way 
interactions  were  significant:  (a)  target  type  by  target  distance 
(x’(3)  =  12.52,  p  <  0.01)  and  (b)  target  type  by  pilot  type  (x*(3) 
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=  10.82,  s  <  0.05).  These  two  interactions  are  depicted  in  Figures 
4  and  5,  respectively. 

Figure  4  shows  that  response  accuracy  was  greater  for  the  F- 15 
targets  than  for  the  F-16  targets  and  that  accuracy  diminished  as 
the  simulated  distances  of  the  targets  increased.  The  rate  of 
change  in  response  accuracy  across  the  four  distances  was  not  the 
same,  however,  for  two  target  types.  For  the  F-15  targets, 
response  accuracy  declined  at  a  greater  rate  between  1.0  and  2.0 
nmi,  whereas  accuracy  decreased  more  rapidly  between  0.5  and  1.0 
nmi  for  the  F-16  targets.  Because  the  response  data  were  summed 
across  the  16  target  orientations,  this  figure  depicts  the  overall 
relationship  between  target  type  and  target  distance  and  is  not 
necessarily  indicative  of  the  association  for  a  specific  target 
orientation. 

In  the  target  type  by  pilot  type  interaction,  it  can  be  seen 
(Fig.  5)  that  there  was  a  small  increase  in  response  accuracy 
across  pilot  types  for  the  F-16  targets  and  that  for  the  F-15 
targets  the  trend  is  the  same  except  for  the  B-Course  pilots  who 
had  slightly  fewer  correct  responses.  The  interaction  also 
Indicates  that  response  accuracy  was  consistently  greater  for  the 
F-15  targets  than  the  F-16  targets  for  each  of  the  four  pilot 
types . 

Pilot's  aircraft  type  was  not  a  significant  factor  in  the 
analysis,  neither  as  a  main  effect  nor  in  the  interactions.  This 
means  that  response  accuracy  was  not  influenced  by  the  type  of 
aircraft  the  pilot  participants  were  currently  flying.  In  other 
words,  the  F-15  pilots  were  not  able  to  distinguish  the  F-15 
targets  any  better  than  the  F-16  and  A-7  pilots,  and  the  F-16 
pilots  could  not  discriminate  the  F-16  targets  more  accurately  than 
the  F-15  and  A-7  pilots. 

Because  the  differences  in  accuracy  between  pilot  types  were 
relatively  minor  and  because  accuracy  was  not  significantly 
influenced  by  the  pilot's  aircraft  type,  these  two  variables  were 
not  treated  as  separate  factors  in  the  subsequent  analyses. 
Instead,  the  response  data  were  collapsed  across  both  pilot  type 
and  pilot's  aircraft  type  in  each  of  the  analyses. 

Response  Accuracy  as  a  Function  of  Target  Pitch.  Target  Type, 
and  Target  Distance.  In  the  second  analysis,  a  three-factor  model 
was  used  to  compare  target  pitch,  target  type,  and  target  distance. 
The  pitch  factor  consisted  of  three  levels:  pitch  up,  pitch  down, 
and  no  pitch.  The  pilot's  pitch  response  was  used  in  this 
analysis. 

Each  of  the  three  main  effects  was  significant,  as  follows: 
(1)  target  pitch  (x*(2)  =  23.69,  p  <  0.01),  (2)  target  type  (x*(l) 

=  24.85,  E  <  0.01),  and  (3)  target  distance  (x*(3)  “  49.85,  p  < 
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Target  Type 


Response  Accuracy  as  a  Function  of  Target  Type  and  Distance 


Ibrget  type 
CZD  F-15 


Response  Accuracy  as  a  Function  of  Target  Type  and  Pilot  Type 


0.01) .  The  correct  response  percentages  for  the  three  main  effects 
are  provided  in  Table  8 .  None  of  the  interactions  was 
statistically  significant. 


Table  8.  Correct  Responses  for  the  Main  Effects 
in  the  Analysis  Comparing  Target  Pitch 


Main  effect 

Correct  responses 
(percent) 

Target  pitch 

Pitch  up 

98.75 

Pitch  down 

98.34 

No  pitch 

96.52 

Target  type 

F-15 

98.59 

F-16 

96.48 

Target  distance 

(nmi) 

0.5 

99.06 

1.0 

98.44 

2.0 

97.73 

3.0 

94.92 

Comparison  of  the  correct  response  percentages  in  Table  8 
reveals  that  the  pilots  could  distinguish  the  pitched  targets  with 
greater  facility  than  the  nonpitched  targets,  and  that  the  nose- 
high  and  nose- low  targets  were  about  equally  discriminable.  As 
reflected  in  the  target  type  and  target  distance  main  ef^cts, 
pitch  recognition  accuracy  was  facilitated  by  the  larger,  F-15 
targets  in  contrast  to  the  F-16  targets  and  accuracy  declined  as 
the  simulated  distance  of  the  targets  increased. 

Response  Accuracy  as  a  Function  of  Direction  of  Travel .  Target 
Type,  and  Target  Distance.  The  data  were  then  subjected  to  a 
three-factor  analysis  to  evaluate  the  relationship  between 
direction  of  travel,  target  type,  and  target  distance.  There  were 
three  levels  of  the  direction  of  travel  factor:  left,  fore/aft,  and 
right.  The  purpose  of  this  analysis  was  to  determine  how  well  the 
pilots  could  distinguish  whether  the  targets  were  turned  left, 
turned  right,  or  not  turned  (i.e.,  fore/aft).  We  were  not 
concerned  at  this  juncture  with  the  pilots'  ability  to  discern 
whether  the  targets  were  pointed  toward  or  away  from  them,  which  is 
examined  in  subsequent  analyses.  Consequently,  for  this  analysis, 
the  45-,  90-,  and  135-deg  aspect  targets  with  the  left  direction  of 
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travel  were  combined;  the  0-  and  180-deg  aspect  targets  were 
combined  for  the  fore/aft  direction  of  travel;  and  the  45-,  90- , 
and  135-deg  aspect  targets  with  the  right  direction  of  travel  were 
combined.  The  pilot's  direction  of  travel  response  was  the  score 
used  in  this  analysis.  For  the  fore/aft  direction  of  travel,  the 
pilot's  response  was  also  considered  correct  if  he  specified  180- 
deg  aspect  when  the  actual  aspect  angle  was  0-deg  and  vice  versa. 
The  pilots  were  given  credit  for  these  responses  because  they 
correctly  indicated  that  the  target  was  not  turned. 

The  direction  of  travel  main  effect  was  significant  (x^(2)  == 
49.38,  p  <  0.01),  along  with  the  main  effects  of  target  type  (x^(l) 
«  15.09,  E  <  0.01)  and  target  distance  (x^(3)  =  127.09,  p  <  0.01). 
The  two-way  direction  of  travel  by  target  type  interaction  was  also 
significant  (x*(2)  =  S.72,  p  <  0.05).  The  correct  response 

percentages  associated  with  the  four  distances  of  the  target 
distance  main  effect  were  respectively  99.79,  99.51,  96.84,  and 
93.32.  The  direction  of  travel  by  target  type  interaction  is 
graphically  illustrated  in  Figure  6. 

Figure  6  distinctly  shows  that  the  left  and  right  directions 
of  travel  were  more  discernible  than  the  fore/aft  direction  and 
that  the  left  and  right  directions  were  about  equally 
discriminable.  The  figure  also  indicates  that  the  direction  of 
travel  of  the  F-15  targets  was  more  recognizable  than  the  direction 
of  the  F-16  targets,  although  the  difference  between  the  two  target 
types  was  not  as  large  for  the  fore/aft  direction  of  travel,  which 
accounts  for  the  significant  interaction  that  was  obtained. 

Response  Accuracy  as  a  Function  of  Target  Bank.  Target  Type, 
and  Target  Distance.  Two  three-factor  analyses  were  subsequently 
conducted,  and  the  factors  in  both  analyses  were  target  bank, 
target  type,  and  target  distance.  All  of  the  banked  targets  were 
combined  and  all  of  the  targets  that  were  not  banked  were  combined 
to  form  two  levels  of  the  target  bank  factor:  bank  and  no  bank.  A 
different  set  of  bank  scores  was  produced  for  each  of  the  analyses; 
a  set  of  "liberal”  scores  was  used  in  one  and  a  set  of  "strict" 
scores  was  used  in  the  other.  A  response  was  considered  correct 
1  according  to  the  liberal  scoring  method  if  the  pilot  correctly 
identified  whether  the  target  was  banked,  without  regard  to  the 
I  direction  of  bank,  or  not  banked.  For  example,  if  a  target  with  a 
right  bank  was  presented  and  the  pilot  indicated  a  left  bank,  he 
obviously  could  distinguish  that  it  was  banked  and  was  credited 
with  a  correct  response.  The  purpose  of  the  liberal  scoring 
approach  was  to  determine  how  efficiently  pilots  could  discern 
whether  the  targets  were  simply  banked.  With  the  strict  scoring 
(method,  the  pilots'  responses  were  considered  correct  only  when 
jth^y  accurately  identified  the  direction  of  bank  of  the  banked 
targets  and  indicated  that  the  nonbanked  targets  were  not  banked. 
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To  illustrate,  if  the  pilot  indicated  a  left  bank  when  a  target 
with  a  right  bank  was  presented,  the  response  was  incorrect.  This 
scoring  technique  was  implemented  to  determine  the  pilots'  ability 
to  recognize  the  direction  the  targets  were  banked. 

In  the  analysis  using  the  liberal  bank  scores,  the  main  effect 
of  target  bank  was  significant  (x^(i)  =  59.36,  p  <  0.01),  along  with 
the  main  effects  of  target  type  (x^(l)  =  33.27,  p  <  0.01)  and  target 
distance  (x*(3)  =  87.26,  p  <  0.01).  In  addition,  the  two-way, 
target  bank  by  target  distance  interaction  was  significant  (x^(3) 
=  17.23,  p  <  0.01)  and  the  three-way,  target  bank  by  target  type  by 
target  distance  interaction  was  significant  (x^(3)  =  12.33,  p  < 
0.01). 

When  the  strict  bank  scores  were  subjected  to  analysis, 
significant  main  effects  were  observed  for  target  bank  (x^(l)  = 
215.86,  p  <  0.01),  target-type  (x*(l)  =  93.82,  p  <  0.01),  and  target 
distance  (x*(3)  =  352.49,  p  <  0.01).  Two  two-way  interactions  were 
significant,  target  bank  by  target  distance  (x^(3)  8.28,  p  <  0.05) 
and  target  type  by  target  distance  (x^(3)  =  18.44,  p  <  0.01).  The 
three-way  interaction  was  also  significant  (x*(3)  =  22.39,  p  < 
0.01). 

The  significant  three-way  Interactions  in  the  two  analyses  are 
depicted  simultaneously  in  Figures  7  and  8.  The  response  accuracy 
for  the  F-15  targets  is  presented  in  Figure  7,  and  Figure  8  shows 
the  response  accuracy  corresponding  to  the  F-16  targets.  In  both 
the  liberal  and  strict  scoring  methods,  the  scores  for  the  targets 
that  were  not  banked  were  the  same.  For  this  reason,  there  is  only 
one  "no-bank"  condition  in  each  of  the  figures. 

It  can  be  observed  in  Figures  7  and  8  that  the  pilots  could 
quite  accurately  discern  when  the  F-15  and  F-16  were  banked,  up  to 
the  maximum  distance  used  in  this  investigation  of  3  nmi.  When  the 
targets  were  not  banked,  bank  recognition  accuracy  declined 
noticeably  at  the  two  greater  distances.  The  strict  bank  scores 
indicate  that  the  accuracy  with  which  the  left  and  right  directions 
of  bank  could  be  distinguished  decreased  sharply  as  a  function  of 
distance  and  aircraft  type. 


Response  Accuracy  as  a  Function  of  Aspect  Angle.  Target  Type, 
and  Target  Distance.  Next,  a  three-factor  analysis  was  conducted 
that  encompassed  target  aspect,  target  type,  and  target  distance. 
The  target-aspect  factor  consisted  of  five  aspect  conditions,  as 
follows: 
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Aspect 

condition 


Aspect  angle 
(deg) 


1 

2 

3 

4 

5 


0 

45 

90 

135 

180 


For  this  analysis,  all  the  targets  with  the  sane  aspect  angle 
were  combined.  The  score  used  in  the  analysis  was  the  pilot's 
aspect  angle  response  for  each  of  the  target  presentations. 

Significant  main  effects  were  obtained  in  the  j  analysis  for 
target  aspect  (x*(4)  =  370.98,  p  <  0.01),  target  type  (x*(l) 
172.91,  c  <  0.01),  and  target  distance  (x^(3)  “  279.78,  p  <  0.01). 
The  two-way,  target  aspect  by  target  type  interaction  was 
significant  (x^(4)  -  15.05,  p  <  0.01),  as  well  as  the  ^target  aspect 
by  target  distance  interaction  (x^(12)  «  123.92,  p  <  0.01)  and  the 
target  type  by  target  distance  interaction  (x*(3)  *  17.67,  p  < 
0.01) .  In  addition,  the  three-way,  target  aspect  by  target  ti^'pe  by 
target  distance  Interaction  was  significant  (x^(12)  I*  23.93,  p  < 
0.05).  Figures  9  and  10  depict  the  three-way  intetaction.  The 
correct  response  percentages  associated  with  the  F-lj5  targets  are 
provided  in  Figure  9,  and  Figure  10  presents  the  percentages 
corresponding  to  the  F-16  targets.  j 

The  errors  that  were  made  by  the  pilots  when  the  aspect  angles 
were  incorrectly  identified  will  be  addressed  in  greater  detail  in 
the  subsequent  target  orientation  comparisons.  Suffide  to  say  that 
the  predominant  aspect  response  was  ISO  deg  when  the  0-deg  aspect 
targets  were  mlsldentlfled,  and  vice  versa.  It  was  also  observed 
that  the  aspect  responses  were  almost  exclusively  90  and/or  135  deg 
for  the  45-deg  aspect  errors,  45  and/or  135  deg  for  the  90-deg 
aspect  errors,  and  45  and/or  90  deg  for  the  135-deg  aspect  errors. 

Response  Accuracy  as  a  Function  of  Target  Orientation.  Target 
Type,  and  Target  Distance.  The  specific  target  orientations  were 
evaluated  along  with  target  type  and  target  distance  in  the 
subsequent  analyses.  The  response  accxiracy  associated  with  the 
target  type  and  target  distance  for  each  of  the  target  orientations 
is  provided  in  Table  9.  The  target  orientations  are  rank  ordered 
in  the  table  in  accordance  with  the  total  percentage  of  correct 
responses.  The  specific  types  of  errors  the  pilots  committed  in 
relation  to  each  of  the  target  orientations  are  presented  in 
Appendix  C. 


31 


100 


SSS889Sa^<=> 

(luoojad)  Aoeinaov  asuodsay 


32 


Aspect  Angle  (degrees) 

Figure  9 

Response  Accuracy  for  the  F-15  Targets  as 
J’^nction  of  Aspect  Angle  and  Distance 
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Aspect  Angle  (degrees) 

Figure  10 

Response  Accuracy  for  the  F-16  Targets  as 
Function  of  Aspect  Angle  and  Distance 


Table  9.  Percent  Correct  Responses  as  a  Function  of  Target 
Orientation,  Type,  and  Distance 
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A  total  of  10  analyses  was  conducted,  6  three-factor  analyses, 
1  four-factor  analysis,  and  3  two-factor  analyses.  A  correct 
response  in  these  analyses  was  defined  as  a  correct  aspect  angle, 
direction  of  travel,  pitch  attitude,  and  bank  attitude  response. 
The  composite  response  was  incorrect  if  any  individual  response  was 
in  error. 

The  target  orientations  that  were  compared  in  each  analysis 
were  selected  in  order  to  isolate  the  effects  of  the  target 
characteristics  on  detection  accxiracy.  In  the  first  analysis,  for 
example,  where  target  orientations  3  and  15  were  compared,  the 
effect  of  rotating  the  nose  of  the  target  45  deg  to  the  right  was 
evaluated  when  all  the  other  target  characteristics  were  held 
constant.  In  the  second  analysis,  which  involved  a  comparison 
between  target  orientations  15  and  16,  the  effect  of  pitching  the 
nose  down  45  deg  was  determined  when  the  aspect  angle,  direction  of 
travel,  and  bank  angle  were  constant. 

Target  Orientation  Analysis  1.  The  factors  encompassed  in  the 
three-factor  analyses  were:  (a)  target  orientation,  (b)  target 
type,  and  (c)  target  distance.  The  following  target  orientations 
were  compared  in  the  first  of  these  analyses: 


Target 

Aspect  angle 

Direction 

Pitch  angle 

Bank  angle 

orientation 

(deg) 

of  travel 

(deg) 

(deg) 

3 

180 

Nose-on 

0 

0 

15 

135 

Right 

0 

0 

The  target  orientation  main  effect  was  statistically 
significant  (x^(l)  -  45.79,  p  <  0.01),  as  were  the  main  effects  of 
target  type  (x*(l)  =  35.45,  p  <  0.01)  and  target  distance  (x*(3)  = 
132.85,  p  <  0.01).  The  correct  response  percentages  associated 
with  each  of  the  main  effects  are  provided  in  Table  10,  and  the 
error  responses  for  the  two  target  orientations  are  provided  in 
Tables  3  and  15  in  Appendix  C.  None  of  the  interactions  was 
statistically  significant. 

The  incorrect  responses  associated  with  the  two  target 
orientations  were  predominantly  in  the  form  of  aspect  recognition 
errors,  rather  than  incorrect  direction  of  travel,  pitch,  or  bank 
responses.  Of  the  aspect  errors  committed  in  response  to  target 
orientation  3,  0  deg  was  designated  most  often,  while  for  target 
orientation  15,  45  deg  was  specified  with  the  greatest  regularity 
followed  by  90  deg. 
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Table  10.  Correct  Responses  for  the  Main  Effects  in  the 

Analysis  Comparing  Target  Orientations  3  and  15 


Main  effect  Correct  responses 

(percent) 


Target  orientation 

3 

65.63 

15 

42.50 

Target  type 

F-15 

64.06 

F-16 

44.06 

Target  distance  (nmi) 

0.5 

86.25 

i.o 

57.50 

2.0 

39.38 

3.0 

33.13 

1 

i 


Taroet 

Orientatiob 

Analysis _ 2* 

The  target 

orientations 

compared  in 

the  second 

three-factor  analysis  were  the  following: 

Target 

Aspect  ang 

le 

Direction 

Pitch  angle 

Bank  angle 

orientation 

(deg) 

of  travel 

(deg) 

(deg) 

15 

135 

Right 

0 

0 

16 

135 

Right 

45  Down 

0 

Significant  main  effects  were  observed  for  target  orientation 
(X*(l)  =  29.36,  E  <  0.01),  target  type  (x*(l)  *  58.33,  e  <  0.01), 
and  target  distance  (x^(3)  »  123.74,  e  <  O.Ol).  Table  11  presents 
the  correct  response  percentages  for  each  main  effect,  and  the 
error  responses  corresponding  to  the  two  target  orientations  are 
provided  in  Tables  15  and  16  in  Appendix  C.  None  of  the 
interactions  attained  statistical  significance. 

As  previously  noted,  aspect  errors  were  the  most  prevalent  of 
the  incorrect  responses  for  target  orientation  15.  For  target 
orientation  16,  however,  there  was  a  large  number  of  aspect  errors 
as  well  as  bank  errors,  even  though  the  targets  were  not  banked. 
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Table  11.  Correct  Responses  for  the  Main  Effects  in  the  Analysis 
Comparing  Target  Orientations  15  and  16 


Main  effect  Correct  responses 

(percent) 


Target 


Target 


Target 


orientation 


15 

42 . 50 

16 

25.63 

type 

F-15 

46.56 

F-16 

21.56 

distance  (nmi) 

0.5 

63.75 

1.0 

38.13 

2.0 

21.25 

3.0 

13.13 

The  aspect  angle  designated  with  the  highest  frequency  among  the 
aspect  errors  was  45  deg,  and  both  left  and  right  bank  angles  were 
erroneously  attributed  to  the  target.  A  right  bank  was  specified 
with  the  greatest  regularity  when  only  the  bank  angle  was 
incorrect,  and  a  left  bank  was  usually  indicated  when  the  target 
was  perceived  as  being  at  a  45-deg  aspect  and  also  in  a  bank 
attitude . 


Target  Orientation  Analysis  3.  The  target  orientations 
evaluated  in  the  subsequent  analysis  consisted  of: 


Target 

Aspect  angle 

Direction 

Pitch  angle 

Bank  angle 

orientation 

(deg) 

of  travel 

(deg) 

(deg) 

9 

45 

Left 

0 

45  Left 

12 

135 

Left 

0 

45  Left 

The  main  effects  in  the  analysis  were  significant  for  target 
orientation  (x^(l)  *=  16.44,  p  <  O.Ol),  target  type  (x*(l)  =  44.33, 
fi  <  0.01),  and  target  distance  (x*(3)  *  15.05,  p  <  0.01).  The 
various  interactions  associated  with  this  analysis  were  not 
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statistically  significant.  The  correct  response  percentages  for 
the  main  effects  are  presented  in  Table  12,  and  Tables  9  and  12  in 
Appendix  C  indicate  the  corresponding  response  errors. 

The  response  errors  committed  by  the  pilots  in  connection  with 
target  orientation  9  consisted  principally  of  a  mix  of  aspect, 
pitch,  and  bank  angle  errors.  When  the  aspect  angle  and/or  the 
direction  of  bank  was  incorrect,  the  pilots  mainly  indicated  that 
the  target  aspect  was  135  deg  and  the  target  was  banked  right.  In 
all  but  one  instance  where  the  pilots  incorrectly  Identified  the 
pitch  angle,  a  nose-high  attitude  was  attributed  to  the  target. 

For  target  orientation  12 ,  the  incorrect  responses  were 
predominantly  aspect  and/or  bank  errors.  The  aspect  angle 
specified  most  of  the  time  among  the  aspect  errors  was  45  deg,  and 
a  right  bank  was  designated  with  the  greatest  frequency  when  the 
bank  was  incorrect.  The  errors  became  more  diverse  as  the  target 
distance  increased,  which  was  characterized  by  the  production  of 
direction  of  travel  and  pitch  errors.  At  this  target  orientation, 
the  pilots  primarily  indicated  a  nose-low  attitude  when  pitch  was 
incorrect. 


Target  Orientation  Analysis  4.  In  the  fourth  ^three-factor 
analysis,  the  following  two  target  orientations  were* compared: 


Target 

Aspect  angle 

Direction 

Pitch  angle 

Bank  angle 

orientation 

(deg) 

of  travel 

(deg) 

(deg) 

5 

90 

Left 

45  Down 

0 

10 

45 

Left 

45  Down 

0 

This  analysis  yielded  a  significant  main  effect  for  target 
orientation  (x*{l)  =  38,37,  p  <  0.01),  target  type  (x’(l)  =  30.22, 
p  <  0.01),  and  target  distance  (x^(3)  *  64.04,  p  <  0.01).  In 
addition,  the  two-way  target  orientation  by  target  type  interaction 
was  significant  (x^(l)  15.56,  p  <  0.01).  For  the  main  effect  of 
target  distance,  the  response  accuracy  associated  with  each  of  the 
distances  in  ascending  order  was  85.63,  77.50,  60.63,  and  50.63%. 
Figure  11  Illustrates  the  response  accuracy  profiles  in  the  target 
orientation  by  target  type  interaction.  Tables  5  and  10  in 
Appendix  C  present  the  error  responses  corresponding  to  the  two 
target  orientations. 

It  is  evident  in  Figure  11  that  response  accuracy  was  greater 
for  the  F-15  targets  than  the  F-16  targets  and  that  target 
orientation  5  was  more  conducive  to  accurate  orientation 
recognition  than  target  orientation  10.  The  decline  in  accuracy 
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Table  12.  Correct  Responses  for  the  Main  Effects  in  the 

Analysis  Comparing  Target  Orientations  9  and  12 


Main  effect  Correct  responses 

(percent) 

Target  orientation 

9 

81.88 

12 

68.75 

Target  type 

F-15 

86.25 

F-16 

64.38 

Target  distance  (nmi) 

0.5 

85.00 

1.0 

76.25 

2.0 

70.63 

3.0 

69.38 

between  the  two  target  orientations,  however,  was  much  greater  for 
the  F~15  targets  than  the  F~16  targets,  which  accounts  for  the 
significant  interaction.  The  error  responses  for  target 
orientation  5  and  10  indicate  that  when  the  pilots  responded 
incorrectly,  they  primarily  misjudged  the  target  aspect  angle 
and/or  bank  angle. 


,  Target  Orientation  Analysis  5.  The  target  orientations 
addressed  in  the  subsequent  analysis  were: 


Target 

Aspect  angle 

Direction 

Pitch  angle 

Bank  angle 

orientation 

(deg) 

of  travel 

(deg) 

(deg) 

6 

90 

Left 

0 

60  Left 

7 

90 

Right 

0 

60  Left 

In  addition  to  the  significant  main  effect  of  target 
orientation  (x*(l)  =  57.86,  p  <  0.01),  the  main  effects  were 
significant  for  target  type  (x*(l)  “  9.73,  p  <  0.01)  and  target 
distance  (x*(3)  “  124.28,  p  <  O.Ol).  The  two-way,  target 
orientation  by  target  distance  interaction  was  also  significant 


(X^(3)  =  13.41,  SL  <  0.01).  The  correct  response  percentages 
corresponding  to  the  F-15  and  F-16  targets  in  the  main  effect  of 
target  type  were  79.06  and  70.94,  respectively,  and  the  percentages 
for  the  target  orientation  by  target  distance  interaction  are 
presented  in  Figure  12 .  The  errors  made  by  the  pilots  relative  to 
the  target  orientations  are  ovided  in  Tables  6  and  7  in  Appendix 
C. 


Figure  12  shows  that  response  accuracy  for  target  orientation 
6  decreased  as  a  function  of  target  distance  and  that  the  largest 
decline  occurred  when  the  distance  increased  from  2.0  to  3.0  nmi. 
Response  accuracy  for  target  orientation  7  at  the  0.5  and  1.0  nmi 
distances  was  very  nearly  Identical  to  the  accuracy  at  the 
corresponding  distances  for  target  orientation  6.  Accuracy 
decreased  very  abruptly,  however,  for  target  orientation  7  when  the 
distance  increased  from  1.0  to  2.0  nmi.  This  was  followed  by  a 
smaller  decline  from  2.0  to  3.0  nmi.  Host  of  the  response  errors 
that  were  committed  were  due  to  a  misidentification  of  the 
direction  of  bank. 


Target  Orientation  Analysis  6.  The  next  analysis  encompassed 
the  following  target  orientations: 


Target 

Aspect  angle 

Direction 

Pitch  angle 

Bank  angle 

orientation 

(deg) 

of  travel 

(deg) 

(deg) 

9 

45 

Left 

0 

45  Left 

13 

45 

Right 

0 

45  Left 

In  this  analysis,  the  main  effect  of  target  orientation  was 
significant  (x^(l)  =  13.37,  p  <  0.01),  as  well  as  the  main  effect 
of  target  type  (x*(l)  =  40.41,  p  <  0.01)  and  target  distance  (x*(3) 
=  74.14,  p  <  0.01).  There  was  one  significant  two-way  interaction, 
which  occurred  between  target  orientation  and  target  distance  (x^(3) 
»  27.81,  p  <  0.01).  In  the  main  effect  of  target  type,  response 
accuracy  was  86.25%  for  the  F-15  targets  and  66.56%  for  the  F-16 
targets.  The  correct  response  percentages  associated  with  the 
target  orientation  by  target  distance  interaction  are  depicted  in 
Figure  13,  and  the  response  errors  are  presented  in  Tables  9  and  13 
in  Appendix  C. 

Response  accuracy  for  target  orientation  9  decreased  only 
slightly  across  the  four  simulated  distances  employed  in  the 
present  investigation  (Fig.  13),  with  the  largest  reduction 
occurring  when  the  distance  increased  from  1.0  to  2.0  nmi.  There 
was  no  difference  in  accuracy  between  the  2.0  and  3.0  nmi 
distances.  The  nature  of  the  response  errors  pertaining  to  target 
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Figure  13 

Response  Accuracy  as  a  Function  of  Target  Distance 
and  Target  Orientations  9  and  13 


orientation  9  have  been  examined  previously  in  the  comparison 
between  target  orientations  9  and  12. 

Response  accuracy  for  target  orientation  13  dropped 
precipitously  when  the  simulated  target  distance  Increased  from  1.0 
to  2.0  nmi,  and  there  was  a  further  sharp  decline  in  accuracy  when 
the  target  distance  was  increased  to  3.0  nmi.  There  was  a  wide 
range  of  orientation  errors,  which  included  incorrect  aspect 
angles,  directions  of  travel,  pitch  attitudes,  and  directions  of 
bank.  The  most  common  orientation  designated  when  an  error  was 
committed  was  a  135-deg  aspect  with  a  right  bank,  and  a  90-deg 
aspect  was  the  next  most  frequent  error. 

Target  Orientation  Analysis  7.  In  the  four-factor  analysis 
that  was  conducted,  the  factors  were  target  aspect,  target  pitch, 
target  type,  and  target  distance.  There  were  two  target  aspect 
conditions,  0  and  180  deg,  and  two  target  pitch  conditions,  nose- 
level  and  nose-high.  The  target  aspect  and  target  pitch  conditions 
were  formed  in  this  analysis  using  the  following  four  target 
orientations : 


Target 

orientation 

Aspect  angle 
(deg) 

Direction 
of  travel 

Pitch  angle 
(deg) 

Bank  angle 
(deg) 

1 

0 

Tail-on 

0 

0 

2 

0 

Tail-on 

45  Up 

0 

3 

180 

Nose-on 

0 

0 

4 

180 

Nose-on 

45  Up 

0 

In  the  analysis,  three  main  effects,  three  two-way 
interactions,  and  two  three-way  interactions  were  statistically 
significant.  The  significant  main  effects  were:  (a)  target  pitch 
(X^(i)  “  27.68,  E  <  0.01),  (b)  target  type  (x*(l)  *  24.09,  E  < 
0.01),  and  (c)  target  distance  (x*(3)  *  92.53,  e  <  0.01).  The  two- 
way  interactions  were:  (a)  target  aspect  by  target  pitch  (x*(l)  “ 
69.61,  E  <  0.01),  (b)  target  pitch  by  target  type  (x*(l)  =  14.36, 
E  <  0.01),  and  (c)  target  aspect  by  target  distance  (x^(3)  =  76.63, 
E  <  0.01).  The  three-way  interactions  consisted  of:  (a)  target 
aspect  by  target  pitch  by  target  type  (x*(l)  =  7.47,  e  <  0.01)  and 
(b)  target  aspect  by  target  pitch  by  target  distance  (x^(3)  =  17.07, 
E  <  0.01) . 

The  three-way  interactions  are  illustrated  in  Figures  14  and 
15.  The  four  target  orientations  that  comprise  the  four  target- 
aspect  by  target-pitch  combinations  are  specified  in  the  figures. 
Comparison  of  target  orientations  1  and  2  in  the  figures  shows  the 
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Target  Orientation 


effects  of  changing  target  pitch  on  response  accuracy  when  the 
targets  are  tail-on,  ar.d  comparison  of  orientations  3  and  4 
reflects  the  effects  of  pitch  when  the  targets  are  nose-on.  The 
difference  in  response  accuracy  between  target  orientations  1  and 

3  is  indicative  of  a  nose-on  to  tail-on  target  aspect  change  with 
0-deg  pitch,  and  the  difference  between  target  orientations  2  and 

4  quantifies  the  influence  of  the  aspect  change  when  the  targets 
are  pitched  up. 

The  error  responses  induced  by  the  four  target  orientations 
are  presented  in  Tables  1,  2,  3,  and  4  in  Appendix  C.  In  most 
cases,  the  pilots  designated  the  opposite  aspect  angle  when  an 
error  occurred,  i.e.,  0  deg  for  180-deg  targets  and  180  deg  for  0- 
deg  targets.  As  the  simulated  target  distances  increased,  the 
errors  became  more  diverse,  resulting  in  aspect  angle,  direction  of 
travel,  target  pitch,  and  target  bank  errors. 

Target  Orientation  Analysis  8.  In  the  last  three  analyses, 
the  effects  of  three  different  target  orientations  on  recognition 
accuracy  were  separately  evaluated.  A  two-factor  model  was  used  in 
each  of  these  analyses,  and  the  factors  were  target  type  and  target 
distance. 

The  target  orientation  in  the  first  of  the  two-factor  analyses 
was  as  follows: 


Target 

Aspect  angle 

Direction 

Pitch  angle 

Bank  angle 

orientation 

(deg) 

of  travel 

(deg) 

(deg) 

8 

90 

Right 

45  Up 

120  Left 

In  this  analysis,  the  target  type  main  effect  was  significant 
(X^(l)  =  19.89,  s  <  0.01),  as  well  as  the  target  distance  main 
effect  (x*(3)  =  46j.00,  p  <  0.01)  and  the  target  type  by  target 
distance  interaction  (x^(3)  14.51,  p  <  0.01).  The  interaction  is 
portrayed  in  Figure  16,  where  it  can  be  observed  that  there  was  a 
large  difference  in\  response  accuracy  between  the  two  target  types 
at  0.5  and  1.0  nml  ^nd  a  very  small  difference  at  2.0  and  3.0  nmi. 
At  2.0  nmi,  response  accuracy  for  the  F-16  targets  was  actually 
better  than  the  accuracy  for  the  F-15  targets,  but  this  represents 
a  difference  of  onlj^  four  errors. 

Table  8  in  Appendix  C  presents  the  error  responses  for  target 
orientation  8.  The  pilots  missed  mainly  the  aspect  angle  and  the 
direction  of  bank.  A  right  bank  was  almost  exclusively  specified 
when  the  bank  was  incorrect,  and  a  45-deg  aspect  was  designated 
most  often  when  the  target  aspect  was  Incorrectly  identified. 
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Response  Accuracy  for  Target  Orientation  8  as  a  Function  of 

Target  Type  and  Distance 


Target  Orientation  Analysis  9.  In  the  second  two-factor 
analysis,  the  following  target  orientation  was  used: 


Target 

Aspect  angle 

Direction 

Pitch  angle 

Bank  angle 

orientation 

(deg) 

of  travel 

(deg) 

(deg) 

11 

135 

Left 

45  Up 

45  Right 

The  main 

effect  of  target  type  was 

significant 

(X*(l)  “  12.61, 

£  <  0.01)  and  the  target  distance  main  effect  was  significant 
(X^(3)  =  62.31,  £  <  0.01)  in  this  analysis.  There  was  no 
statistically  significant  interaction.  The  response  accuracy 
associated  with  F-15  and  F-16  targets  was  30.63  and  15.63%, 
respectively,  and  the  response  accuracy  corresponding  to  the  four 
distances  was  respectively  50.00,  28.75,  5.00,  and  8.75%. 

The  error  responses  in  conjunction  with  target  orientation  11 
are  presented  in  Table  11  in  Appendix  C.  The  pilots  typically  felt 
the  target  aspect  was  either  45  or  90  deg  and  the  target  was  banked 
left  when  the  rarget  aspect  and/or  target  bank  was  incorrectly 
identified. 

Target  Orientation  Analysis  10.  The  target  orientation 
encompassed  in  the  final  two-factor  analysis  was  as  follows; 


Target 

Aspect  angle 

Direction 

Pitch  angle 

Bank  angle 

orientation 

(deg) 

of  travel 

(deg) 

(deg) 

14 

45 

Right 

45  Down 

45  Right 

A  significant  target  type  main  effect  (x*(l)  “  21.06,  £  < 
0.01),  target  distance  main  effect  (x*(3)  =  19.24,  £  <  0.01),  and 
target  type  by  target  distance  interaction  (x*(3)  =  14.39,  £  <  0.01) 
were  observed  in  this  analysis.  Figure  17  illustrates  the 
interaction,  and  it  may  be  seen  that  the  difference  in  response 
accuracy  between  the  two  target  types  decreased  as  the  simulated 
distance  of  the  targets  increased.  Examination  of  the  error 
responses,  which  are  provided  in  Table  14  in  Appendix  C,  shows  that 
the  target  was  primarily  interpreted  as  being  in  a  wings-level 
attitvide  (0-deg  bank)  and  that  the  target  aspect  was  90  or  135  dgg 
when  the  bank  and/or  target  aspect  were  incorrect. 
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Debriefing  Questionnaire 


The  debriefing  questionnaire  was  administered  mainly  to 
determine  if  the  slides  provided  a  realistic  simulation  of  the 
target  orientation  assessment  task  in  air-to-air  combat  and  if  the 
procedures  used  in  the  investigation  may  have  influenced  the 
pilots'  responses.  The  specific  questions  that  were  contained  in 
the  questionnaire,  the  pilots'  responses,  and  the  explanations 
provided  by  the  pilots  for  their  responses  are  presented  in 
Appendix  D.  With  only  a  few  exceptions,  the  pilots  felt  that  the 
target  images  and  the  simulated  target  distances  were  realistic. 
Half  the  pilots,  however,  indicated  that  there  were  visual  cues 
missing  that  they  normally  use  to  determine  target  orientation, 
including  target  motion,  exhaust  smoke,  wingtip  vortices,  canopy 
and  tail  glint,  and  target  shadows  and  shading. 

The  questionnaire  revealed  that  only  10%  of  the  pilots  thought 
the  task  used  in  the  present  investigation  was  easier  than  actual 
target  orientation  assessment,  18.75%  felt  it  was  about  the  same, 
and  71.25%  concluded  it  was  more  difficult.  Some  of  the  reasons 
given  when  the  task  was  judged  to  be  easier  were  that  the  targets 
were  always  at  the  same  location  and  the  missiles  were  white.  The 
lack  of  target  motion  was  almost  always  given  as  the  reason  why  the 
task  was  felt  to  be  more  difficult.  It  may  be  recalled  that  target 
motion  across  the  cockpit  canopy,  along  with  the  relative  size/size 
changes  of  the  target,  were  two  of  the  most  important  cues  in  air- 
to-air  combat  training  reported  by  the  pilots  in  the  evaluation 
conducted  by  Coward  and  Rupp  (1982). 

The  target  background  in  the  slide  presentations  appeared 
realistic  for  two-thirds  of  the  pilots,  but  unrealistic  for  one- 
third.  The  primary  reason  for  not  being  realistic  was  that  the 
background  never  changed.  In  real-world  flight  conditions,  the 
background  may  be  a  blue  sky,  clouds,  or  ground.  The  background 
was  not  varied  in  the  present  investigation  to  avoid  confounding 
the  target  variables  with  the  background. 

The  pilots  expressed  relatively  few  objections  to  the  conduct 
of  the  investigation.  The  only  problems  deserving  mention  were 
that  9  of  the  80  pilots  experienced  some  fatigue  during  the  slide 
presentations  and  8  of  the  pilots  felt  that  the  slide  presentations 
were  either  too  long  or  too  short. 


DISCUSSION 


Visual  Cue  Usage 

Based  on  the  percentages  of  the  correct  target  orientation 
responses  in  which  the  various  visual  cues  were  used,  as  shown  in 
Table  7,  the  most  important  cues  for  discerning  the  orientation  of 
the  targets  were: 
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1.  tail 

2 .  wings 

3 .  nose 

4.  intake (s) 

5.  planform 

6.  canopy 

7.  belly 

8.  missiles 

9.  top  of  aircraft  or  wings 

10.  fuselage 

11.  exhaust  outlet(s) 

The  balance  of  the  target  cues  that  were  Indicated  were  either 
infrequently  used  or  they  represented  the  absence  of  cues  (e.g.,  no 
tail) . 


In  the  survey  conducted  by  Coward  and  Rupp  (1982) ,  the  four 
most  important  visual  cues  for  air-to-air  combat  training  reported 
by  the  pilots  were:  wing  planform,  nose  position,  relative  motion 
across  the  canopy,  and  relative  size/size  changes.  The  former  two 
visual  cues  were  among  the  most  frequently  designated  by  pilots  in 
the  present  investigation,  especially  at  the  greater  simulated 
distances.  Since  static  target  images  were  used  in  this 
investigation,  the  latter  two  motion-related  cues  identified  by 
Coward  and  Rupp  were  not  available  to  the  pilots  in  the  current 
research . 

Comparison  of  the  pilot  responses  in  Table  7  and  Tables  1 
through  16  in  Appendix  B  clearly  shows  that  the  target  cues  that 
were  used  and  the  extent  they  were  used  were  a  function  of:  (a)  the 
orientation  of  the  target,  (b)  the  type  of  target,  and  (c)  the 
distance  of  the  target.  The  influence  of  target  orientation  on  cue 
usage  is  exemplified  by  comparing  target  orientation  2  and  target 
orientation  4.  In  target  orientation  2,  where  the  target  was 
pointed  directly  away  with  a  nose-high  pitch  attitude,  the  canopy 
was  on  the  observer's  side  of  the  target  fuselage,  and  the  canopy 
was  used  as  a  target  cue  for  orientation  in  22.96%  of  the  correct 
responses.  In  target  orientation  4,  in  which  the  target  was  nose- 
high  and  pointed  directly  toward  the  observer,  the  canopy  was  on 
the  opposite  side  of  the  target  and  was  not  available  as  an 
orientation  cue.  Consequently,  the  canopy  was  not  reported  as  a 
cue  used  for  target  orientation  4. 

It  may  be  noted  that  in  a  few  Instances  the  pilots  indicated 
they  used  target  cues  that  would  not  have  been  visible  to  them. 
For  example,  the  intake  of  the  F-16  target  was  not  visible  in 
target  orientation  2,  yet  a  couple  of  times  the  pilots  reported 
using  the  intake  as  a  cue.  Either  this  was  simply  erroneous  or 
they  meant  that  they  could  not  see  it,  and  to  them  "intake"  was 
synonymous  with  "no  intake." 
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The  effect  of  target  type  on  cue  usage  is  exemplified  by 
contrasting  the  use  of  the  missiles.  The  missiles  were  oh  the 
underside  of  the  F-15  target,  and  were  comprised  of  four  AIM-7  and 
four  AIM-9  missiles.  For  the  F-16  targets,  one  AIM-9  missile  was 
on  either  wingtip.  The  observers  frequently  reported  using  the 
missiles  as  an  orientation  cue  for  the  F-15  targets  when  the 
underside  of  the  targets  was  in  view.  The  missiles  were  rarely 
used  in  conjunction  with  the  F-16  targets. 

It  must  be  pointed  out,  though,  that  the  missiles  were  painted 
white  and  provided  excellent  contrast  with  the  belly  of  the  F-15 
targets.  In  present-day  air  combat  training,  the  missiles  are  a 
grayish  color,  which  reduces  contrast,  and  a  full  missile  load  is 
not  used.  Therefore,  the  use  of  missiles  as  a  cue  for  target 
orientation  in  the  present  investigation  may  overestimate  the  role 
of  missiles  as  a  target  orientation  cue  in  training. 

Target  distance  had  a  pronounced  influence  on  the  cues  that 
were  used.  For  the  most  part,  the  smaller,  more  detailed  cues  were 
used  less  frequently  as  distance  increased  because  the  pilots  were 
increasingly  less  able  to  visually  resolve  the  finer  details, 
whereas  the  larger,  more  global  cues  Increased  in  usage  as  distance 
increased.  For  example,  the  relatively  small  missiles  were 
frequently  reported  as  an  F-15  target  orientation  cue  at  the  closer 
distances,  but  not  at  the  farther  distances.  In  contrast,  the 
target  planform  was  indicated  more  often  as  distance  increased. 

Because  static  target  images  were  used  in  this  research,  none 
of  the  dynamic  cues  to  target  orientation  were  available  to  the 
pilots.  In  normal  training  situations,  targets  may  move  vertically 
and  horizontally  relative  to  the  attacker,  as  well  as  toward  and 
away  from  the  attacker.  Furthermore,  targets  may  produce  vapor 
trails,  exhaust  smoke,  canopy  glint,  and  afterburner  illumination, 
along  with  other  dynamic  visual  cues.  The  investigation  reported 
by  Coward  and  Rupp  (1982)  suggests  that  these  dynamic  cues  are 
important  sources  of  target  orientation  information.  Therefore,  it 
is  likely  that  target  orientation  response  accuracy  would  be 
greater  in  a  high-fidelity,  dynamic  environment  than  under  the 
static  conditions  employed  in  this  investigation,  particularly  at 
the  longest  distances. 


Response  Accuracy 

The  analyses  indicated  that  the  orientation  recognition 
accuracy  associated  with  the  F-15  targets  was  usually  greater  than 
the  accuracy  obtained  with  the  F-16  targets.  The  reasons  for  this 
are  that  the  F-15  fighter  is  much  larger  and  is  configured 
differently  than  the  F-16  fighter.  The  F-15  is  63  ft,  9  in.  in 
length  and  42  ft,  10  in.  in  width  from  wingtip  to  wingtip.  It  has 
two  tail  fins,  an  air  inlet  on  either  side  of  the  fuselage,  and  two 
side-by-side  exhaust  outlets  in  the  tail  section.  The  F-16 


53 


fighter,  on  the  other  hand,  is  49  ft,  3  in.  long  (including  nose 
probe)  and  32  ft,  10  in.  wide  (including  missile  fins),  and  it  has 
a  single  tail  fin,  one  air  inlet  under  the  nose,  and  one  exhaust 
outlet  below  the  tail  fin.  There  were  various  other  differences 
between  the  two  targets.  For  example,  the  camouflage  color  schemes 
were  dissimilar  and  the  weapons  loads  were  different  (i.e.,  the  F- 
16  was  equipped  with  a  missile  on  either  wingtip,  whereas  the 
armament  for  the  F-15  was  located  under  the  wings  and  consisted  of 
eight  missiles) . 

In  the  bulk  of  the  analyses,  target  orientation  recognition 
accuracy  declined  when  the  target  distance  increased.  This 
reduction  in  accuracy  occurred  because  as  the  size  of  the  targets 
on  the  screen  diminished  as  distance  increased,  the  physical 
features  that  provided  cues  to  orientation  became  more  difficult  to 
visually  resolve  and,  therefore,  less  visible.  The  Instances  in 
which  response  accuracy  was  not  influenced  by  target  distance,  as 
well  as  the  exceptions  corresponding  to  target  type,  will  be 
addressed  later  in  the  discussion. 

The  differences  in  response  accuracy  between  the  four  types  of 
pilots  used  in  the  present  investigation  were  dependent  on  the  type 
of  targets  the  pilots  viewed,  as  evidenced  by  the  significant  pilot 
type  by  target  type  interaction  that  was  obtained  in  the  initial 
analysis  where  the  16  target  orientations  were  pooled.  The 
differences  in  response  accuracy  were  relatively  small,  however; 
consequently,  the  response  data  were  summed  across  the  four  pilot 
types  in  the  subsequent  analyses.  The  distribution  of  the  percent 
correct  responses  associated  with  the  interaction  revealed  (Fig.  5) 
that  response  accuracy  was  nearly  the  same  between  the  pilots  who 
viewed  the  F~16  targets,  and  except  for  the  B-Course  pilots,  the 
accuracy  was  very  similar  between  the  pilots  who  were  presented  the 
F-15  targets.  The  B-Course  pilots  were  slightly  less  accurate  in 
judging  the  orientations  of  the  F-15  targets,  which  accounted  for 
the  significant  interaction.  These  findings  suggest  that  the  B- 
Course  pilots  had  learned  to  discriminate  the  orientations  of  the 
F-16  targets  about  as  well  as  the  other  pilots,  but  not  the 
orientations  of  the  F-15  targets.  Inspection  of  the  pilots'  flight 
experience  in  Table  4  shows  that  the  B-Course  pilots  had  flown 
between  64.04  and  70.83%  fewer  air-to-air  training  sorties  than  the 
other  pilots. 

The  type  of  aircraft  the  pilots  were  flying  had  no  bearing  on 
target  orientation  recognition  accuracy  when  the  16  target 
orientations  were  pooled,  as  witnessed  by  the  absence  of  a 
difference  between  the  "same"  and  "different"  pilot's  aircraft 
types.  "Same"  signifies  that  the  targets  the  pilots  viewed  were 
the  same  as  the  fighter  they  flew,  and  "different"  denotes  the 
opposite.  The  lack  of  a  difference  in  response  accuracy  means  that 
they  were  no  better  at  detennlnlng  the  orientation  of  the  targets 
that  were  the  same  as  their  own  fighter  and  no  worse  when  the 
targets  were  different  from  their  own  fighter.  Because  there  were 


no  differences,  the  response  data  were  sunned  across  the  two  pilot 
aircraft  types  in  the  renainlng  analyses. 

Both  target  direction  of  travel  and  target  pitch  were 
conparatively  easy  for  the  pilots  to  discern  in  the  slide 
presentations.  Since  there  was  very  little  deterioration  in 
response  accuracy  as  target  distance  Increased,  it  is  sumised  that 
the  visual  cues  the  pilots  reported  using  at  the  longer  distances, 
nainly  the  nose,  tail,  and  planfom,  were  the  prinary  cues  used  to 
detemine  the  left  and  right  directions  of  travel  and  pitch.  The 
absence  of  these  cues  and  the  presence  of  a  nere  circular  spot  were 
the  chief  indicators  of  the  direction  of  travel  and  pitch  when  the 
target  was  either  nose-on  or  tail-on  and  at  0-deg  pitch  at  the 
longer  distances.  At  the  closer  distances,  the  pilots  could 
distinguish  the  finer  cues,  such  as  the  air  inlet,  canopy,  and 
exhaust,  which  were  undoubtedly  the  principal  cues  used  to 
determine  whether  the  target  was  pointed  toward  or  away  from  the 
pilot.  Thus,  to  provide  a  realistic  flight  simulator  visual 
environment,  the  pilot  should  be  able  to  discriminate  the  left  and 
right  directions  of  travel  and  the  pitch  of  a  simulated  target  up 
to  at  least  3.0  nml.  The  distance  at  which  the  pilot  should  be 
able  to  distinguish  whether  the  target  is  nose-on  or  tail-on  will 
be  discussed  later. 

The  analysis  of  the  bank  error  scores  revealed  that  the  pilots 
could  fairly  easily  distinguish  when  the  targets  were  banked,  and 
that  bank  recognition  accuracy  did  not  vary  substantially  across 
the  four  simulated  target  distances  used.  It  is,  therefore, 
essential  that  the  pilots  are  able  to  recognize  a  banked  target  up 
to  at  least  3.0  nmi  in  a  flight  simulator  to  provide  an  environment 
comparable  to  actual  training.  The  target  wings  and  planform  are 
the  dominant  indicators  of  target  bank.  Determining  the  direction 
of  bank  (l.e.,  left  or  right)  proved  to  be  far  more  error  inducing 
than  just  determining  whether  or  not  the  targets  were  banked,  but 
this  was  dependent  upon  the  type  of  target  portrayed  on  the  screen. 
For  the  F-15  targets,  the  direction  of  bank  was  more  difficult  to 
distinguish  only  at  2.0  and  3.0  nmi  where  response  accuracy  was 
near  the  chance  level.  For  the  F-16  targets,  discriminating  the 
direction  of  bank  was  more  difficult  than  just  determining  whether 
the  target  was  banked  across  the  four  target  distances,  although 
the  difference  was  much  smaller  at  0.5  nmi.  The  rationale  for  this 
occurrence  is  simply  ^at  the  pilots  could  not  reliably  distinguish 
the  top  of  the  target  from  the  bottom.  Based  on  these 
observations,  the  distance  at  which  the  pilots  should  be  capable  of 
discriminating  the  direction  of  bank  of  a  simulated  target  should 
be  at  least  1.0  nmi  for  an  F-15  target  and  between  0.5  and  1.0  nmi 
for  an  F-16  target. 

Aspect  recognition  accuracy  varied  considerably  between  the 
aspect  angles  used  in  the  present  Investigation.  The  significant 
three-way,  aspect  angle  by  target  type  by  target  distance 
interaction  indicated  that  aspect  recognition  accuracy  was  also 
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Influenced  by  target  type  and  target  distance.  Comparisons  of  the 
individual  target  orientations,  which  are  discussed  below.  Indicate 
that  target  pitch  and  bank  attitude  also  contributed  to  the 
differences  in  aspect  recognition  accuracy. 

Of  the  various  aspect  angles  evaluated,  the  number  of  just 
aspect  recognition  errors  was  lowest  for  target  orientations  6  and 
7,  as  shown  in  Tables  6  and  7  in  Appendix  C.  If  the  bank  errors 
are  omitted  in  the  tables,  it  can  be  seen  that  there  were 
relatively  few  aspect  reccgnition  errors  at  these  orientations. 
Therefore,  to  provide  real-world,  target  aspect  recognition  in  a 
flight  simulator,  the  pilots  should  be  able  to  discriminate  90-deg 
aspect  up  to  3.0  nml  when  the  target  is  not  pitched  and  is  banked 
60  deg  relative  to  the  pilot.  It  is  conjectured  that  if  the  pilot 
can  recognize  the  aspect  of  target  orientations  6  and  7  at  3.0  nml, 
the  other  aspect  conditions  used  in  the  present  Investigation  will 
also  be  recognizable  at  their  real-world  distances,  so  long  as  the 
cues  the  pilots  used  to  determine  the  aspect  angles  at  those 
distances  are  visible. 

The  specific  target  orlei.tations  were  compared  in  the  analyses 
to  isolate  the  effects  of  changes  in  target  aspect,  pitch,  or  bank 
on  orientation  recognition  accuracy.  In  the  comparison  of  target 
orientations  3  and  15,  the  influence  of  the  difference  in  target 
aspect  between  180  deg  and  135  deg  was  evaluated.  Except  for  the 
F-15  target  at  0.5  nmi ,  target  orientation  15  promoted  far  more 
orientation  recognition  errors  than  orientation  3.  The  errors  for 
target  orientation  15  indicated  that  the  elevated  error  rate  was 
primarily  due  to  the  pilots  assuming  that  the  target  was  oriented 
away  from  them  at  a  45-deg  aspect.  This  suggests  that  they  could 
distinguish,  for  the  most  part,  that  the  target  was  oriented 
diagonally  to  their  line  of  sight,  and  that  they  assumed  the  target 
was  most  likely  going  away  from  them  rather  than  toward  them. 

Target  orientations  15  and  16  were  compared  to  identify  the 
effect  of  a  change  in  target  pitch  on  orientation  recognition 
accuracy.  It  was  found  that  orientation  16,  in  which  the  target 
was  pitched  down,  resulted  in  significantly  more  errors  than 
orientation  15,  where  the  target  was  not  pitched.  Just  as  with 
target  orientation  15,  the  pilots  incorrectly  identified  most  often 
the  aspect  of  orientation  16  as  45  deg.  The  pilots  also 
misidentified  the  bank  angle  of  orientation  16  fairly  frequently, 
even  though  the  targets  were  not  banked,  which  primarily  accounted 
for  the  higher  error  rate.  Among  the  bank  errors,  a  right  bank  was 
the  most  common  error.  This  suggests  when  the  pilots  could  see  the 
top  of  the  target  or  thought  they  were  viewing  the  top,  they 
frequently  surmised  that  it  was  in  a  right  bank.  It  is  also 
probable  that  they  assximed  that  if  the  target  were  not  banked,  the 
wingtip  would  be  even  with  the  fuselage. 

The  effect  of  a  change  in  target  aspect  in  conjunction  with  a 
left  target  bank  on  response  accuracy  was  evaluated  in  the  target 
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orientation  9  and  12  comparison.  Overall,  response  accuracy  for 
target  orientation  9,  which  entailed  a  45-deg  aspect  was  second 
highest  of  the  target  orientations  evaluated  and  sixth  highest  for 
target  orientation  12,  where  the  aspect  angle  was  135  deg.  A  large 
part  of  the  increased  error  rate  associated  with  orientation  12  was 
due  to  a  tendency  to  interpret  the  135*’deg  aspect  angle  as  45  deg, 
as  explained  abo  e  for  target  orientation  15,  and  to  interpret  the 
left  bank  as  a  right  bank. 

Target  orientations  5  and  10  provided  a  comparison  of  the 
effect  of  a  change  in  aspect  with  a  nose-down  attitude  on  response 
accuracy.  In  this  comparison,  a  significant  interaction  was 
observed  between  target  orientation  and  target  type.  For  target 
orientation  5  in  which  the  aspect  angle  was  90  deg,  orientation 
recognition  was  much  more  efficient  in  connection  with  the  F-15 
targets  than  with  the  F-16  targets.  The  pilots  rarely 
misidentif led  the  F-15  target  orientations,  and  of  the  incorrect 
responses  associated  with  the  F-16  targets,  aspect  and/or  bank 
angle  were  the  predominant  errors.  Response  accuracy  was  lower  for 
target  orientation  10,  which  employed  a  45-deg  aspect,  and  the 
reduction  in  accuracy  was  far  greater  for  the  F-15  targets  compared 
to  orientation  5.  The  pilots  mainly  misinterpreted  aspect  and/or 
bank  relative  to  target  orientation  10.  i 

Based  on  the  difference  in  response  laccuracy  between  these 
target  orientations,  it  is  evident  that  the  full-length  side  view 
provided  by  orientation  5  afforded  better ! orientation  cuing  than 
the  belly  view  and  shorter  physical  screen  size  of  the  targets 
corresponding  to  target  orientation  10.  Furthermore,  since  the 
difference  in  response  accuracy  between  the  F-15  and  F-16  targets 
was  not  as  great  for  orientation  10  as  for  orientation  5,  it  can  be 
asserted  that  the  enhanced  orientation  cuing  provided  by  the  larger 
F-15  is  degraded  when  the  target  is  angled  45  deg  away  from  the 
perpendicular  with  a  nose-down  attitude.  | 

The  comparison  between  target  orientations  6  and  7  addressed 
the  effects  on  response  accuracy  of  a  change  in  direction  of  travel 
from  left  to  right,  when  the  target  aspect  was  90  deg  and  the 
targets  were  in  a  left  bank.  In  target  orientation  6,  with  the 
left  direction  of  travel,  the  top  of  the  targets  faced  the  pilots, 
and  the  bottom  of  the  targets  faced  the  pilots  in  target 
orientation  7.  In  the  analysis,  a  significant  interaction  was 
obtained  between  target  orientation  and  target  distance.  For 
target  orientation  6,  response  accuracy  declined  slightly  between 
0.5  and  1.0  nmi,  then  remained  essentially  constant  between  1.0  and 
2.0  nmi,  and  fell  again  between  2.0  and  3.0  nmi.  The  response 
accuracy  for  target  orientation  7  was  nearly  identical  to  the 
accuracy  for  orientation  6  at  0.5  and  1.0  nmi,  but  between  1.0  and 
3.0  nmi,  it  dropped  precipitously.  Almost  all  of  the  errors  the 
pilots  committed  were  incorrect  bank  responses. 
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The  explanation  for  this  occurrence  is  relatively  simple.  At 
0.5  and  1.0  nmi,  both  target  orientations  were  fairly  easily  and 
equally  distinguishable.  At  2.0  and  3.0  nmi,  however,  the  pilots 
could  not  discern  the  top  from  the  bottom  of  the  target  as 
efficiently,  which  provide  the  left  and  right  angle  of  bank  cues. 
Therefore,  based  on  their  past  experience,  the  pilots  assumed  that 
the  targets  were  turning  toward  them  and  that  the  top  of  the  target 
was  facing  them  when  they  could  not  discriminate  the  top  from  the 
bottom.  This  was  the  correct  Interpretation  of  target  orientation 
6,  but  not  orientation  7. 

Target  orientations  9  and  13  permitted  a  comparison  of  a  left 
and  right  direction  of  travel  when  the  target  aspect  was  45  deg  and 
the  targets  were  in  a  left  bank.  In  target  orientation  9,  which 
simulated  a  left  direction  of  travel^  the  top  of  the  target  was 
toward  the  pilots,  and  the  pilots  had  a  bottom  view  in  target 
orientation  13,  which  portrayed  a  right  direction  of  travel.  A 
significant  interaction  was  observed  in  the  analysis  between  target 
orientation  and  target  distance,  which  is  depicted  in  Figure  13. 
The  relationship  between  the  two  target  orientations  across  the 
four  target  distances  was  the  same  as  the  relationship  between 
target  orientations  6  and  7,  which  was  described  previously, 

It  can  be  seen  in  Figure  13  that  both  target  orientations  9 
and  13  were  about  equally  discernible  and  reasonably  easy  to 
distinguish  at  0.5  and  1.0  nmi.  Although  it  seems  that  the  pilots 
were  also  able  to  fairly  accurately  recognize  target  orientation  9 
at  2.0  and  3.0  nmi,  but  not  target  orientation  13,  an  alternative 
explanation  is  more  tenable,  which  is  based  on  the  illusory  reverse 
target  orientation.  In  the  present  investigation,  the  45-  and  135- 
deg  target  aspect  angles  were  reversible  when  the  finer  target 
details  could  not  be  visually  resolved.  For  example,  a  target  with 
a  45-deg  aspect,  a  right  direction  of  travel,  and  a  left  bank  could 
appear  as  a  target  orientation  with  a  135-deg  aspect,  a  right 
direction  of  travel,  and  right  bank.  This  can  be  demonstrated  by 
viewing  one  of  the  45-  or  135-deg  aspect  slides  in  Appendix  A  at  a 
sufficient  distance  so  that  the  smaller  details  cannot  be  seen. 

It  is  the  authors'  contention  that,  based  on  the  pilots'  prior 
flight  experience,  the  reverse  orientation  for  target  orientation 
9  in  the  present  investigation  was  less  likely  than  the  actual 
orientation,  therefore,  their  responses  were  mostly  correct.  For 
target  orientation  13,  however,  the  reverse  orientation  was  more 
likely  as  the  finer  target  details  became  more  difficult  to 
resolve,  which  prompted  them  to  incorrectly  specify  the  reverse 
orientation  with  greater  regularity.  This  assumption  is 
corroborated  by  the  error  responses  that  were  made  in  conjunction 
with  target  orientation  13.  The  reverse  target  orientation  concept 
also  provides  an  explanation  for  the  consistently  incorrect 
responses  that  occurred  in  relation  to  the  various  other  target 
orientations  used  in  the  Investigation. 
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Target  orientations  1  through  4  provided  a  comparison  between 
the  nose-on  and  tail-on  targets  when  they  were  pitched  and  not 
pitched.  In  this  evaluation,  two  three-way  interactions  were 
significant,  target  aspect  angle  by  pitch  by  type  (Fig.  14)  and 
target  aspect  angle  by  pitch  by  distance  (Fig.  15) .  The  first 
interaction  (Fig.  14)  revealed  that  response  accuracy  was  greater 
for  the  F-15  targets  than  the  F-16  targets,  except  with  target 
orientation  1.  A  review  of  the  incorrect  responses  in  Appendix  C 
corresponding  to  target  orientation  1  shows  that  the  errors  for  the 
F-15  targets  were  greater  than  the  errors  for  the  F-16  targets  at 
0.5  and  1.0  nmi.  Although  the  targets  were  actually  tail-on,  the 
pilots  invariably  indicated  that  the  targets  were  nose-on  at  these 
two  distances  when  the  F-15  target  orientations  were  incorrectly 
identified.  This  signifies  that  the  tail-on  orientation  of  the  F- 
15  targets  was  slightly  more  difficult  to  distinguish  than  tail-on 
orientation  of  the  F-16  targets  at  the  two  closer  distances. 

In  the  second  interaction  (Fig.  15),  the  two  most  critical 
comparisons  are  between  target  orientation  1  and  3  and  between 
orientations  2  and  4.  It  is  evident  in  Figure  15  that  the  pilots 
could  efficiently  identify  target  orientation  3  at  0.5  nmi  where 
the  target  was  nose-on  to  the  pilot.  Then,  as  the  distance 
increased,  response  accuracy  correspondingly  declined.  The  pilots 
were  not  as  accurate  interpreting  the  direction  of  travel  in  target 
orientation  1  as  in  orientation  3 ,  and  the  elevated  error  rates 
occurred  across  the  four  simulated  distances  used  in  the 
investigation.  Due  to  the  shape  of  the  response  distributions  over 
the  four  distances,  it  would  appear  that  when  the  pilots  were 
unable  to  accurately  Interpret  the  direction  of  travel,  they 
basically  guessed  that  it  was  either  nose-on  or  tail-on.  Had  they 
employed  a  decision  rule  based  on  their  previous  flight  experience 
where,  for  example,  they  may  have  indicated  that  the  target  was 
nose-on  whenever  they  could  not  distinguish  target  direction,  then 
response  accuracy  would  have  been  much  higher  over  the  four 
distances  for  target  orientation  3  and  much  lower  for  orientation 
1. 


In  the  comparison  between  target  orientations  2  and  4,  it  is 
clearly  evident  that  such  a  decision  rule  was  implemented,  which 
resulted  in  the  characteristic  response  distributions.  At  0.5  and 
1.0  nmi,  the  visual  cues  provided  reasonable  orientation  cuing  and 
response  accuracy  was  relatively  good.  At  2.0  and  3.0  nmi, 
however,  the  majority  of  pilots  could  not  clearly  distinguish 
whether  the  pitched  up  target  was  nose-on  or  tail-on. 
Consequently,  they  indicated  a  tail-on  orientation  based  on  their 
previous  flight  experience,  which  was  correct  for  target 
orientation  2  but  not  orientation  4.  Of  the  errors  that  were  made 
in  conjunction  with  target  orientation  4,  the  pilots  primarily 
indicated  that  the  target  aspect  was  0  deg,  which  is  the  reverse 
target  orientation  of  orientation  4. 
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Target  orientations  8  and  14  proved  to  be  among  the  most 
difficult  for  the  pilots  to  Interpret.  For  both  these  target 
orientations,  there  was  a  significant  target  type  by  target 
distance  interaction,  as  shown  in  Figures  16  and  17,  respectively. 
At  0.5  and  1.0  nmi,  response  accuracy  was  superior  for  the  F-15 
targets,  and  at  the  longer  distances,  the  differences  between  the 
target  types  were  negligible.  These  interactions  suggest  that  the 
physical  features  and  larger  size  of  the  F*-15  targets  provided  more 
effective  orientation  cuing  at  the  closer  distances  for  target 
orientations  8  and  14,  but  the  cuing  advantages  of  the  F- 15  targets 
were  eliminated  by  the  longer  distances. 

Target  orientation  8  was  primarily  conducive  to  aspect  and/or 
direction  of  bank  errors.  The  pilots  specified  a  right  bank  almost 
exclusively  when  the  target  bank  was  incorrectly  identified.  This 
is  consistent  with  the  nature  of  the  errors  observed  for  target 
orientation  7,  which  provided  the  same  90-deg  aspect  and  direction 
of  bank.  As  previously  stated,  it  is  apparent  that  the  pilots 
assumed  the  targets  were  turning  toward  them  when  they  were  unable 
to  distinguish  the  top  from  the  bottom  of  the  targets.  The  target 
aspect  designated  most  often  when  the  aspect  was  misinterpreted  was 
45  deg.  In  contrast,  there  were  hardly  any  aspect  errors 
associated  with  target  orientation  7.  It  would  therefore  appear 
that  the  larger  angle  of  bank  (l.e.,  120  deg)  coupled  with  the 
nose-high  attitude  creates  a  strong  false  impression  of  the  target 
aspect. 

In  target  orientation  14,  the  banked  wing  was  in  line  with  the 
target  fuselage,  which  the  pilots  frequently  interpreted  as  no 
bank.  In  addition,  the  pilots  often  indicated  erroneously  that 
target  aspect  was  90  deg  with  no  bank.  In  this  orientation,  the 
wing  would  be  in  line  with  the  fuselage,  the  same  as  target 
orientation  14.  The  pilots  also  specified  the  reverse  target 
aspect  (i.e.,  135  deg)  numerous  times. 

Of  the  various  target  orientations  evaluated  in  this 
investigation,  target  orientation  11  was  the  most  difficult  to 
interpret  correctly.  A  variety  of  errors  was  made,  although  the 
reverse  target  orientation  was  most  commonly  specified.  The  pilots 
rarely  mis interpreted  only  the  direction  of  bank;  they  either 
incorrectly  identified  the  aspect  or  the  aspect  and  bank.  It  is  of 
interest  to  note  that  among  the  errors  committed  in  relation  to 
target  orientation  12,  which  also  portrayed  a  135-deg  aspect,  the 
pilots  rarely  indicated  that  the  aspect  was  90  deg.  In  contrast, 
a  90-deg  aspect  was  frequently  designated  in  response  to  target 
orientation  11.  This  would  seem  to  suggest  that  the  nose-high 
attitude  in  orientation  11  had  a  heavy  Influence  on  the  perception 
of  target  aspect. 
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RECOMMENDATIONS 


In  order  to  facilitate  the  prac.ical  application  of  the 
results  cf  the  present  investigation,  a  ->et  of  recommendations  was 
produced  for  use  in  the  visual  simulatxon  of  air-to-air  combat. 
Because  target  motion  was  not  simulated  in  this  investigation, 
these  recommendations  are  applicable  ^o  static  image  presentations. 
The  recommendations  that  were  develop  d  are  provided  here. 

Target  Distance 

Air-to-air  combat  engagements  within  visual  range  are 
performed  at  various  slant  range  distances  up  to  about  3.0  nml.  At 
these  distances,  different  target  cue  arrays  will  be  visible  due  to 
the  decreasing  power  of  the  eyes  to  resolve  finer  details  as 
distance  increases.  Therefore,  to  provide  high-fidelity 
simulation,  the  visual  cues  pilots  use  for  target  orientation 
assessment  should  be  resolvable  at  the  distances  corresponding  to 
real-world  training  operations. 

Target  Detail 

Simulated  target  aircraft  should  be  modeled  to  resemble  as 
closely  as  possible  the  targets  that  are  anticipated  in  the  actual 
training  environment.  Generally  speaking,  when  greater  target 
detail  is  provided,  target  orientation  assessment  is  facilitated. 
The  nose,  wings,  tail,  and  fuselage  are  essential  cues,  especially 
from  2.0  to  3.0  nml.  At  0.5  and  1.0  nmi,  smaller  target  details 
provide  additional  orientation  cues.  These  cues  include  the 
canopy,  missiles,  air  intakes,  and  exhaust  outlets.  The  simulated 
target  paint  scheme  is  also  critical  because  it  will  determine  how 
well  the  target  contrasts  with  the  background  and  it  may  influence 
the  pilots'  ability  to  distinguish  the  top  and  the  bottom  of  the 
target.  In  the  debriefing  questionnaire,  the  pilots  indicated  that 
they  use  a  number  of  other  visual  cues,  including  canopy  glint, 
engine  smoke,  contrails,  and  afterburner  glow.  Therefore,  these 
cues  should  be  provided  when  feasible  for  the  simulation  system  and 
appropriate  for  the  simulated  target. 

Target  Type 

The  size  and  configuration  of  the  target  aircraft  will  have  a 
significant  influence  on  target  orientation  recognition  accuracy  in 
air-to-air  combat  engagements.  At  a  given  distance,  larger  targets 
with  richer  details  will  promote  greater  orientation  recognition 
accuracy.  Therefore,  it  may  be  advisable  to  introduce  larger, 
richly  detailed  targets  during  initial  simulation  training  phases 
to  permit  the  pilots  to  develop  and  refine  their  target  orientation 
assessment  skills.  As  they  progress,  these  targets  can  be 
eliminated  in  favor  of  the  target  types  that  will  be  encountered  in 
actual  flight  training. 
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Target  Pitch 


The  visual  display  should  allow  pilots  to  differentiate 
whether  a  target  aircraft  is  pitched  upward  or  downward  at  a 
simulated  distance  of  at  least  3.0  nmi.  To  accurately  recognize 
target  pitch  at  this  distance,  the  edges  of  the  target  must  be 
sharply  defined  and  the  target  must  contrast  sufficiently  with  the 
background.  Because  the  direction  the  nose  is  pointed,  the 
relative  position  of  the  nose  and  tail,  and  the  sweep  of  the  wings 
are  the  primary  determinants  of  target  pitch,  these  cues  must  be 
distinctly  visible. 


Target  Bank 

Pilots  should  be  able  to  distinguish  whether  a  target  is 
banked  at  a  simulated  distance  of  at  least  3.0  nmi.  Since  the 
wings  and  planform  are  the  dominant  cues  for  bank,  the  wings  should 
be  discriminable  from  the  fuselage  and  background  at  this  distance. 
The  direction  lof  bank  (l.e.,  left  and  right)  is  far  more  difficult 
to  determine  | than  merely  whether  the  target  is  banked.  To 
accurately  specify  the  direction  of  bank,  the  pilot  must  be  able  to 
discriminate  the  top  from  the  bottom  of  the  target,  which  is 
influenced  by'  the  difference  in  coloring  and  detail,  such  as 
missiles  and  canopy.  For  F>15  and  F-16  simulated  targets  modeled 
in  the  fashion]  used  in  this  investigation,  the  direction  of  bank  of 
the  F-15  targets  should  be  recognizable  at  a  minimum  of  1.0  nmi, 
and  between  0.5  and  1.0  nmi  for  the  F>16  targets. 


Left  and  Right  Target  Direction  of  Travel 


The  left 
discriminable 


Consequently, 

suprathreshold 


and  right  target  directions  of  travel  should  be 
up  to  at  least  3.0  nmi.  The  direction  the  nose  is 
pointed,  the  i-elative  positioning  of  the  nose  and  tail,  and  the 
sweep  of  the  ^ings  constitute  the  main  direction-of -travel  cues. 

sharply  defined  edges  of  the  target  aircraft  and  a 
level  of  contrast  are  required  to  accurately 


identify  the  direction  of  travel  at  this  distance. 


Target  Aspect 


The  simulation  should  permit  pilots  to  accurately  recognize  a 
target  aspect  of  90  deg  (i.e.,  the  target  is  perpendicular  to  the 
line  of  sight)  up  to  at  least  3.0  nmi  when  the  target  is  not 
pitched  and  is  banked  60  deg  relative  to  the  observer.  It  is 
surmised  that  if  the  pilots  can  accurately  recognize  this  target 
orientation  at  3.0  nmi,  the  other  target  orientations  will  be 
recognizable  at  their  real-world  detection  distances.  The  physical 
relationship  between  the  nose  and  the  wings  and  between  the  wings 
and  tall  are  the  principal  determinants  of  aspect.  Consequently, 
a  clearly  defined  aircraft  outline  is  essential  to  accurate  aspect 
recognition  at  3.0  nmi. 
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Figure  2.  Target  Orientation  1 
F-16  Target. 


Figure  1.  Target  Orientation  1  - 
F-15  Target. 


Figure  3.  Target  Orientation  2  • 
F-15  Target 


Figure  4.  Target  Orientation  2  - 
F-16  Target 


Figure  5.  Target  Orioitation  3  - 
F-15  Target 


Figure  6.  Target  Orimtation  3  - 
F-16  Target. 
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Figure  7.  Target  Orientation  4  - 
F-15  Target. 


Figure  8.  Target  Orientation  4 
F-16  Target. 


Figure  9.  Target  Orientation  S  • 
F-15  Target. 


Figure  10.  Target  Orientation  5 
F-16  Target. 


Figure  11.  Target  Orientation  6 
F-15  Target. 


Figure  12.  Target  Orientation  6 
F-16  Target. 


Hgure  13.  Target  Orientation  7  - 
F-15  Target. 


Hgure  14.  Target  Orientation  7 
F-16  Target. 


Figure  17.  Target  Orientation  9  • 
F-15  Target. 


lugure  18.  Target  Orientation  9 
F-16  Target. 


Figure  23.  Target  Orientation  12  - 
F-15  Target. 


Figure  24.  Target  Orientation  12 
F-16  Target. 


Figure  25.  Target  Orientation  13  - 
F-15  Target. 


Figure  26.  Target  Orientation  13 
F-16  Target. 


Figure  27.  Target  Orientation  14  - 
F-15  Target. 


Figure  28.  Target  Orientation  14 
F-16  Target. 


Figure  29.  Target  Orientation  15  - 
F-15  Target. 


Figure  30.  Target  Orientation  15 
F-16  Target. 
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APPENDIX  B 

VISUAL  CUES  USED  FOR  16  TARGET  ORIENTATIONS 
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Table  3.  Target  Cues  Used  in  Relation  to  Target  Orientation 
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Table  4.  Target  Cues  Used  in  Relation  to  Target  Orientation 
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Table  5.  Target  Cues  Used  in  Relation  to  Target  Orientation 
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Target  Cues  Used  in  Relation  to  Target  Orientation 
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Table  7 .  Target  Cues  Used  in  Relation  to  Target  Orientation 
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Table  8.  Target  Cues  Used  in  Relation  to  Target  Orientation 
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Table  9.  Target  Cues  Used  in  Relation  to  Target  Orientation 
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Table  14.  Target  Cues  Used  in  Relation  to  Target  Orientation  14 


Table  15.  target  Cues  Used  in  Relation  to  Target  Orientation  15 
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Table  16.  Target  Cues  Used  in  Relation  to  Target  Orientation  16 
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APPENDIX  C 


RESPONSE  ERRORS 


The  tables  in  this  appendix  show  the  various  types  of  errors 
that  were  made  in  conjunction  with  each  of  the  target  orientations, 
and  the  frequency  of  each  type  of  error  is  also  provided  in  the 
tables.  An  example  will  suffice  to  explain  these  tables.  Table  1 
presents  the  response  errors  for  target  orientation  1.  In  target 
orientation  l,  the  targets  were  tail-on  to  the  pilot  observers  and 
the  targets  were  neither  pitched  nor  banked.  Some  of  the  pilots 
felt,  however,  that  the  targets  were  nose-on  and  so  they  indicated 
a  180-deg  aspect,  which  is  represented  by  error  number  1  in  the 
tables.  They  correctly  indicated  that  the  targets  were  not  pitched 
or  banked,  therefore  a  dash  was  placed  in  the  tables.  The  number 
of  pilots  that  interpreted  the  targets  as  being  nose-on  for  each  of 
the  four  distances  is  shown  in  the  tables. 
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Tabl*  1.  Responsa  Errors  for  Targst  Orientation  1 


■  JlesDonse  error _ 

Aspect 

Target  distance. 

fnni) 

Target 

Error 

angle 

Direction 

type 

no. 

(deg) 

of  travel  Pitch 

Bank 

0.9 

1.0 

2.0 

3.0 

Total 

F-15 

1 

180 

as 

21 

26 

13 

14 

74 

2 

90 

Right 

- 

5 

5 

3 

49 

Right 

• 

• 

1 

3 

4' 

4 

90 

Left 

— 

• 

2 

2 

5 

139 

Right 

- 

as 

2 

2 

6 

90 

Right 

- 

Right 

2 

2 

7 

139 

Left 

ea 

• 

1 

1 

2 

8 

49 

Right 

- 

Right 

1 

1 

9 

No  response 

1 

1 

r-19  Total 

' 

21 

26 

24 

22 

93 

r-16 

1 

180 

14 

18 

18 

11 

61 

2 

- 

Up 

m 

3 

3 

3 

180 

es 

Left 

2 

2 

4 

180 

up 

- 

1 

1 

2 

5 

90 

Right 

m 

1 

1 

2 

« 

49 

Loft 

Down 

Right 

1 

1 

7 

49 

Left 

Up 

as 

1 

1 

• 

49 

Left 

up 

Right 

1 

1 

9 

49 

Left 

Left 

1 

1 

10 

49 

Left 

op 

Left 

1 

1 

11 

49 

Right 

Left 

1 

1 

12 

90 

Left 

•  ■ 

• 

1 

1 

13 

90 

Left 

Down 

Left 

1 

1 

14 

90 

Right 

Right 

1 

1 

19 

139 

Left 

Up 

Left 

1 

1 

1C 

139 

Left 

Down 

Left 

1 

1 

17 

180 

«• 

Right 

1 

1 

IS 

• 

• 

Left 

1 

1 

19 

No  response 

1 

1 

r-lC  Total 

14 

19 

29 

26 

84 

Grand  Total 

35 

45 

49 

48 

177 

Mots.  Dash  indicates  corrsct  response. 
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Tabl*  2.  R«»pcns«  Errors  for  Tsrgst  Orisntstion  2 


■  Assponsa 

tcTfir _ 

Aspsct 

iBTgttt ,  dLiitancB, 

-Loan 

Targst 

Error 

angls 

Oiraction 

typs 

no. 

(dag) 

of  travsl 

Pitch 

Bank 

0.5 

1.0 

2.0 

3.0 

Total 

r-15 

1 

iSO 

m 

1 

2 

1 

3 

7 

2 

- 

- 

Right 

2 

2 

3 

m 

Laval 

•• 

1 

1 

P-IS 

Total 

2 

B 

B 

5 

10 

F-16 

1 

110 

17 

IS 

f 

4 

44 

2 

- 

- 

Right 

1 

4 

5 

3 

• 

• 

Laft 

1 

1 

4 

45 

Right 

- 

Right 

1 

1 

3 

43 

Right 

Laval 

Right 

1 

1 

« 

48 

Laft 

Laval 

Laft 

1 

1 

r*lC  Total 

17 

16 

B 

11 

53 

Crand  Total 

19 

If 

10 

16 

63 

Wots.  Dash  indicatss  corrsct  rssponss 


Tmblm  i,  Mapons*  errors  for  Tarqat  Orlantatlon  3 


JHaMBonaa  trror 


Aspact  Taraat  diatanca  fnmil 

Tarqat  Error  angla  Diractlon 

typa  no,  (<3a^)  of  traval  Pitch  lank  0.5  i.O  3.0  3.0  Total 


r-i5 

1 

0 

4B 

a 

7 

11 

13 

32 

45 

Right 

m 

• 

3 

2 

3 

135 

Right 

- 

• 

2 

3 

4 

50 

Right 

- 

• 

1 

1 

S 

to 

Right 

up 

Laft 

1 

1 

• 

to 

Laft 

• 

aa 

1 

1 

7 

45 

Laft 

- 

Laft 

1 

1 

135 

Laft 

m 

- 

1 

1 

f 

m 

- 

Laft 

1 

1 

10 

No  raaponaa 

1 

1 

P-15 

Total 

a 

7 

15 

It 

43 

P*14  1 

0 

m 

4 

1C 

17 

11 

4t 

3 

135 

Right 

- 

Right 

3 

3 

45 

Right 

• 

Uft 

3 

2 

4 

to 

Night 

- 

Right 

1 

1 

• 

No  raaponaa 

1 

1 

45 

Uft 

Down 

Right 

1 

1 

7 

135 

Right 

Down 

Right 

1 

1 

• 

135 

Uft 

up 

Uft 

1 

1 

t 

- 

Uft 

1 

10 

135 

Uft 

- 

Uft 

1 

1 

0 

up 

- 

1 

13 

135 

Uft 

Down 

- 

1 

0 

Down 

• 

1 

14 

135 

Uft 

m 

aa 

1 

1 

15 

to 

Uft 

• 

■m 

1 

P-i«  Total 

4 

17 

33 

33 

C7 

Grand  Total 

B 

34 

3t 

43 

‘i-:‘0 

lota.  Daah  Indicatas  corract  raaponaa. 
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Tabl*  4.  R«apon««  Krrors  for  Taryat  Oriantation  4 


Targat 

-ypa 

Error 

no. 

Aapact 

angla 

fdag) 

Aasponfla,' 

Diraction 
of  traval 

arror 

Pitch 

RanX 

larget-tfiatanca. 

0.5  1.0  2.0 

(nmli 

3.0 

Total 

*  3 

1 

0 

3 

27 

23 

53 

3 

0 

- 

Laft 

1 

1 

3 

0 

- 

Right 

1 

1 

4 

• 

* 

Laft 

1 

1 

5 

• 

Laval 

• 

1 

1 

P-15 

Total 

1 

3 

2t 

25 

57 

r-14 

1 

0 

4 

13 

27 

25 

69 

2 

0 

- 

Laft 

2 

1 

3 

3 

. 

Laval 

-- 

3 

3 

4 

0 

■- 

Right 

2 

2 

S 

45 

Right 

Right 

1 

1 

f 

45 

Right 

Laval 

Right 

1 

1 

135 

Right 

Laval 

Right 

1 

1 

r-l«  Total 

4 

13 

29 

34 

80 

Grand  Total 

5 

16 

57 

59 

137 

wota.  Dash  indicatas  corract  rasponaa 


Tabl*  5.  Raspons*  Errors  for  Target  Orientation  5 


EftRBonflfl-tiXQr. 


Aspect  Target  distance  rnni^ 

Target  Error  angle  Direction 

type  no.  (deg)  of  travel  Pitch  Bank  0.5  1.0  2.0  3.0  Total 


r-i5  1 

Left 

1 

2 

3 

2 

45 

• 

«e 

1 

1 

2 

3 

45 

- 

- 

Right 

1 

1 

4 

135 

- 

- 

1 

1 

5 

135 

- 

« 

Left  1 

1 

« 

135 

- 

- 

Right 

1 

1 

7 

135 

Right 

Level 

Left 

1 

1 

• 

• 

as 

Level 

• 

1 

1 

P-15  Total  2  1  2  «  11 


r-16  1 

45 

Left 

1 

3 

• 

12 

45 

> 

» 

as 

1 

'  1 

4 

5 

11 

3 

- 

- 

- 

Left 

2 

1 

3 

2 

8 

4 

135 

- 

- , 

- 

1 

2 

1 

2 

6 

5 

135 

- 

«  ■ 

Left 

4 

1 

5 

« 

135 

- 

- 

Right 

1 

1 

2 

7 

- 

- 

Right 

2 

2 

4 

• 

45 

- 

• 

Right 

2 

1 

3 

9 

45 

- 

Level 

•* 

1 

1 

10 

45 

■- 

Level 

Right 

1 

1 

11 

• 

• 

Level 

• 

1 

P-16  Total 

4 

11 

19 

22 

56 

Grand  Total 

B 

12 

21 

28 

67 

Dash  indicates  correct  response. 


Tabltt  6.  Rospons*  Errors  for  Targst  Orientation  6 


Target 

type 

Error 

no. 

Aspect 

angle 

(deg) 

JRfiaponse  error _ 

Direction 

of  travel  Pitch  BanX 

Target  distance 

0.5  1.0  2.0 

fnai) 

3.0 

Total 

*•-15 

1 

ee 

.  . 

Right 

1 

1 

1 

2 

5 

2 

45 

ee 

A 

1 

3 

4 

3 

135 

• 

• 

- 

1 

1 

2 

4 

45 

• 

• 

Right 

1 

1 

F-15 

Total 

2 

1 

2 

7 

12 

F-16 

1 

Right 

7 

5 

7 

19 

2 

135 

• 

ee 

1 

3 

4 

3 

45 

e» 

- 

1 

2 

1 

4 

4 

45 

- 

- 

Right 

1 

1 

S 

135 

- 

- 

Right 

1 

1 

6 

- 

• 

Level 

1 

1 

7 

0 

• 

• 

Right 

1 

1 

F-l« 

Total 

2 

8 

8 

13 

31 

Grand  Total 


9 


10 


20 


43 


Table  7.  Rasponsa  Errors  for  Target  Orientation  7 


Target 

type 

Error 

no. 

Aspect 

angle 

(d*g) 

.AcaBonso error _ 

Direction 

of  travel  Pitch  Bank 

larqet  diatance 

0.5  1.0  2.0 

Jiuail 

3.0 

Total 

F-15 

1 

*  • 

Right 

20 

24 

44 

2 

45 

.  - 

•  - 

.  1 

2 

3 

3 

135 

- 

Right 

1 

2 

3 

4 

135 

- 

-  • 

1 

1 

2 

S 

45 

■- 

-  Right 

1 

1 

6 

45 

- 

Down  Right 

^  1 

1 

7 

• 

• 

Level 

1 

1 

F-15  Total 

1 

2 

22 

30 

55 

F-16 

1 

Right 

2 

6 

20 

25 

53 

2 

- 

- 

Level 

1 

2 

3 

3 

45 

• 

•  » 

1 ' 

1 

1 

3 

4 

135 

■  - 

Right 

2 

2 

* 

S 

90 

Left 

•  •  • 

1 

1 

F-l«  Total 

4 

7 

21 

30 

62 

Grand  Total 

D 

43 

60 

117 

Note.  Dash  indicates  correct  response. 
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Tabl«  8.  Response  Errors  for  Target  Orientation  8 


Target 

type 

Error 

no. 

Aspect 

angle 

(deg) 

Response  error _ 

Direction 
of  travel  Pitch 

Bank 

Taroet  distance 

0.5  1.0  2.0 

(nini) 

3.0 

Total 

F-15 

1 

Right 

2 

23 

20 

45 

2 

45 

- 

- 

Right 

1 

1 

5 

9 

16 

3 

45 

- 

- 

4 

6 

1 

11 

4 

135 

•• 

- 

ee 

4 

3 

1 

8 

5 

135 

- 

- 

Right 

1 

3 

4 

6 

- 

- 

Level 

1 

1 

7 

45 

- 

- 

lisvel 

1 

1 

8 

45 

- 

Level 

Right 

1 

1 

9 

135 

Left 

• 

• 

1 

1 

F-15  Total 

10 

13 

32 

33 

88 

F-16 

1 

Right 

3 

16 

11 

10 

40 

2 

45 

- 

- 

12 

7 

8 

10 

37 

3 

45 

- 

- 

Right 

2 

4 

9 

14 

29 

4 

135 

- 

5 

1 

6 

S 

135 

- 

- 

Right 

1 

2 

2 

5 

6 

45 

- 

Level 

3 

3 

7 

45 

- 

Level 

Right 

1 

1 

8 

90 

Left 

- 

Right 

1 

1 

9 

135 

Left 

Level 

1 

1 

F-16  Total 

27 

30 

28 

38 

123 

Grand  Total 

37 

43 

60 

71 

211 

Note.  Dash  indicates  correct  response. 
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Table  9.  Response  Errors  for  Target  Orientation  9 


Target 

type 

Error 

no. 

angle 

(deg) 

Direction 
of  travel 

Pitrh 

Bank  0.5 

1.0 

2.0 

3.0 

Total 

F-15 

1 

Right  1 

1 

2 

4 

2 

- 

ae 

Op 

- . 

1 

2 

1 

4 

3 

90 

- 

— 

1 

1 

2 

4 

135 

• 

— 

- 

1 

1 

2 

5 

135 

- 

- 

Right 

1 

1 

6 

135 

- 

op 

Right 

1 

1 

7 

90 

Right 

Op 

Left 

1 

1 

F-15 

Total 

2 

3 

5 

5 

15 

F-16  1 

Op 

4 

7 

5 

2 

18 

2 

135 

- 

Right 

1 

1 

3 

4 

9 

3 

135 

- 

op 

Right 

1 

2 

1 

4 

4 

- 

- 

Right 

1 

1 

1 

3 

5 

90 

- 

— 

- 

2 

1 

3 

6 

135 

- 

- 

•  ' 

2  ' 

2 

7 

135 

e. 

Down 

Level 

1 

1 

8 

135 

Right 

- 

Right 

1 

1 

9 

90 

- 

- 

Right 

1 

1 

10 

• 

•• 

op 

Level 

1 

1 

F-IS 

Total 

8 

9 

13 

13 

43 

Grand 

Total 

10 

12 

18 

18 

58 

Note.  Dash  indicates  correct  response. 

_ 
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Table  10.  Response  Errors  for  Target  Orientation  10 


Response  error 

Aspect 

Tanet  distance 

Target 

Error 

angle 

Direction 

type 

no. 

(deg) 

of  travel 

Pitch 

Barik 

0.5 

1.0 

2.0 

3.0 

Total 

F-15 

1 

Right 

6 

6 

7 

8 

27 

2 

135 

- 

- 

Left 

1 

5 

8 

14 

3 

135 

- 

- 

- 

3 

2 

5 

10 

4 

- 

- 

- 

Left 

2 

1 

1 

1 

5 

5 

90 

- 

- 

Right 

1 

1 

2 

6 

135 

- 

- 

Right 

1 

1 

7 

0 

Level 

Left 

1 

1 

F-15  Total 

9 

12 

15 

24 

60 

F-16 

1 

135 

Left 

1 

1 

13 

9 

24 

2 

- 

- 

- 

Right 

4 

6 

4 

3 

17 

3 

135 

- 

- 

- 

1 

1 

4 

4 

10 

4 

- 

Left 

2 

2 

3 

7 

5 

135 

- 

- 

Right 

2 

1 

1 

1 

5 

6 

90 

- 

Left 

2 

1 

3 

7 

90 

- 

- 

Right 

2 

2 

8 

90 

Right 

Level 

Left 

1 

1 

9 

135 

Right 

- 

Left 

1 

1 

10 

135 

Right 

- 

Right 

1 

1 

11 

45 

Right 

Level 

Right 

1 

1 

12 

45 

Right 

up 

Left 

1 

1 

13 

• 

• 

Level 

Left 

1 

1 

F-16  Total 

8 

12 

27 

27 

74 

Grand  Total 

17 

24 

42 

51 

134 

Note.  Dash  indicates  correct  response. 
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Table  11.  Response  Errors  for  Target  Orientation  11 


Target 

type 

Aspect 
Error  angle 
no.  (deg) 

Response  error 

Direction 
of  travel  Pitch 

Bank 

0.5  1.0  2.0 

■Lnmj) 

3.0 

Total 

F-15 

1 

45 

Left 

2 

21 

18 

41 

2 

90 

- 

- 

- 

9 

11 

3 

4 

27 

3 

90 

- 

- 

Left 

1 

7 

6 

14 

4 

45 

- 

— 

— 

2 

3 

2 

2 

9 

5 

90 

- 

- 

Level 

2 

2  ' 

1 

5 

6 

- 

- 

- 

Left 

1 

2 

1 

4 

7 

- 

- 

- 

Level 

1 

2 

3 

8 

45 

- 

- 

Level 

1 

2 

3 

9 

- 

- 

Level 

- 

,1 

1 

10 

- 

- 

Level 

Level 

1 

1 

11 

180 

- 

- 

- 

1 

1 

12 

0 

- 

Left 

1 

1 

13 

45 

- 

Down 

- 

1 

1 

F-15 

Total 

16 

24 

38 

33 

111 

F-16  1 

45 

Left 

3 

10 

20 

25 

58 

2 

90 

- 

- 

- 

10 

8 

1 

2 

21 

3 

4b 

- 

<■» 

- 

5 

4 

5 

2 

16 

4 

90 

- 

- 

Left 

3 

4 

7 

2 

16 

5 

45 

- 

- 

Level 

1 

4 

1 

1 

7 

6 

- 

- 

Left 

1 

1 

4 

6 

7 

0 

- 

Left 

1 

2 

3 

8 

90 

- 

- 

Level 

1 

2 

3 

9 

- 

- 

- 

Level 

1 

1 

2 

10 

0 

mm 

Level 

1 

1 

11 

45 

Right 

Down 

- 

1 

1- 

12 

90 

Right 

Down 

Left 

1 

1 

F-16 

Total 

24 

33 

38 

40 

135 

Grand 

Total 

40 

57 

76 

73 

246 

Note.  Dash  indicates  correct  response. 
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Table  12.  Response  Errors  for  Target  Orientation  12 


_  ■ 

Response  error _ 

Aspect 

Taraet  distance 

fnffli) 

Target 

Error 

angle 

Direction 

type 

no. 

(deg) 

of  travel 

Pitch  Bank 

0.5 

1.0 

2.0 

3.0 

Total 

F-15 

1 

45 

Right 

5 

3 

8 

2 

- 

- 

- 

Right 

2 

1 

1 

3 

7 

3 

45 

- 

- 

- 

3 

3 

4 

90 

- 

- 

- 

1 

2 

3 

5 

- 

- 

Do%m 

- 

1 

1 

2 

6 

- 

- 

Down 

Right 

1 

1 

2 

7 

135 

Right 

Down 

Level 

2 

2 

8 

45 

Right 

Down 

Level 

1 

1 

9 

• 

• 

Up 

• 

1 

1 

F-15 

Total 

3 

3 

9 

14 

29 

F-16 

1 

45 

Right 

8 

15 

11 

3 

37 

2 

90 

- 

- 

- 

3 

2 

5 

3 

- 

- 

- 

Right 

4 

4 

4 

- 

- 

- 

Level 

1 

1 

1 

3 

5 

45 

— 

- 

1 

1 

1 

3 

6 

90 

- 

- 

Right 

1 

2 

3 

7 

45 

Right 

- 

Right 

1 

1 

2 

8 

45 

Right 

- 

Level 

2 

2 

9 

45 

Right 

- 

- 

1 

1 

2 

10 

45 

- 

Down 

Right 

1 

1 

2 

11 

45 

Right 

Down 

- 

1 

1 

12 

45 

Right 

Down 

Level 

1 

1 

13 

45 

Right 

Down 

Right 

1 

1 

14 

45 

- 

up 

Right 

1 

1 

15 

135 

Right 

Down 

Level 

1 

1 

16 

135 

Right 

Down 

Right 

1 

1 

17 

90 

- 

- 

Level 

1 

1 

18 

• 

• 

Down 

• 

1 

1 

F-16 

Total 

11 

23 

20 

17 

71 

Grand 

Total 

14 

26 

29 

31 

100 

Note.  Dash  indicates  correct  response 


Tabl*  13.  R««pona«  Errors  for  Targat  Oriantatlon  13 


JStRCSJ!lfi«LJ££S2J:. 


Aapact 

Targat  Error  angla  Diraction 


lArgit  dUUnct  (nail 


typa 

no. 

(dag) 

of  traval 

Pitch 

Bank 

0.5 

1.0 

a.o 

3.0 

Total 

r-15 

138 

40 

m 

Right 

1 

8 

4 

14 

a 

135 

• 

• 

40 

1 

3 

4 

3 

135 

- 

Dotm 

Right 

1 

1 

a 

4 

80 

• 

• 

• 

a 

a 

S 

- 

40 

- 

Laval 

o 

a 

a 

a 

80 

« 

- 

Right 

1 

1 

7 

135 

• 

Down 

Laval 

1 

1 

135 

Laft 

- 

• 

1 

1 

f 

10 

40 

m 

Up 

- 

1 

1 

• 

• 

Down 

m 

1 

1 

P^18  Total 

0 

a 

11 

14 

at 

r-16 

1 

135 

40 

• 

Right 

a 

8 

14 

37 

a 

80 

•• 

40 

• 

3 

a 

4 

4 

13 

3 

m 

40 

« 

Right 

1 

3 

4 

4 

80 

at 

40 

Right 

3 

3 

S 

138 

m 

* 

• 

1 

a 

3 

0 

138 

• 

Down 

Right 

a 

a 

7 

48 

Uft 

Down 

Right 

a 

a 

• 

45 

Laft 

« 

1 

1 

f 

45 

Laft 

• 

Laval 

1 

1 

10 

135 

Laft 

40 

Right 

1 

1 

11 

135 

Laft 

Dotm 

Right 

1 

1 

13 

135 

Laft 

Down 

* 

1 

1 

13 

135 

• 

Down 

Laval 

1 

1 

14 

80 

m 

ao 

Laval 

1 

1 

18 

80 

m 

Down 

m 

1 

1 

10 

« 

m 

40 

Uval 

1 

1 

17 

m 

* 

Up 

ao 

1 

1 

r-lf  Total  4  •  ao  34  44 


erond  Total  4  •  31  to  §3 


loll*  Daah  Indicataa  oorraot  roaponaa. 
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Tabl«  14.  Rasponse  Error*  for  Target  Orientation  14 


Target 

type 

Error 

no. 

Aapect 

angle 

(deg) 

Direction 

of  travel  Pitch  LanX 

larqgt  diatanco. 

0.5  1.0  a.o 

...(nail . 

3.0 

Total 

r-15 

1 

90 

«a 

Level 

1 

• 

30 

39 

a 

• 

«k 

-  Level 

3 

7 

i 

5 

31 

a 

90 

«  ■ 

ea  a* 

3 

• 

3 

5 

17 

4 

135 

-  Level 

3 

5 

• 

1 

15 

S 

135 

m 

« 

1 

a 

3 

2 

• 

« 

135 

m 

•  Left 

a 

3 

5 

7 

- 

m 

Level 

1 

1 

a 

• 

4B 

-  Left 

1 

1 

9 

• 

ea 

Up  Level 

1 

1 

1 

r-15  Total 

11 

35 

29 

34 

99 

r-i* 

1 

90 

» 

•  Level 

17 

17 

13 

13 

59 

a 

• 

e> 

-  Level 

1 

7 

< 

C 

20 

3 

135 

• 

-  Level 

7 

3 

4 

3 

1« 

4 

135 

- 

a 

1 

a 

5 

10 

9 

• 

• 

-  Left 

a 

4 

1 

a 

9 

C 

135 

• 

-  Left 

a 

a 

a 

3 

9 

7 

90 

4*1 

d»  e* 

1 

a 

3 

1 

7 

• 

90 

- 

-  Left 

1 

1 

1 

3 

9 

45 

Left 

-  Left 

1 

1 

r-l«  Total 

33 

3« 

32 

33 

13^ 

Grand  Total 

44 

ii 

•1 

•7 

233 

Moll.  Daah  Indioata*  correct  reaponee. 


Tabl«  15.  Raspons*  Errors  for  Tsrgst  Oriontatlon  15 


JLcaponaft-trraE. 


Aspsct  Taroat  distance  fnaH 

Target  Error  angle  Direction 

type  no.  (deg)  of  travel  Pitch  Bank  0.5  1.0  3.0  3.0  Total 


F-15 

1 

45 

-  -  1 

15 

26 

19 

61 

3 

90 

m 

1 

9 

10 

3 

45 

• 

-  Right 

1 

1 

r-15  Total  1 

15 

27 

29 

72 

F-16  1 

45 

14 

28 

22 

13 

77 

2 

90 

- 

- 

- 

1 

1 

7 

14 

23 

3 

45 

- 

* 

Left 

3 

3 

45 

- 

- 

Right 

2 

2 

9 

- 

.  - 

Right 

1 

1 

2 

6 

• 

• 

Left 

1 

1 

7 

45 

Loft 

• 

• 

1 

1 

a 

45 

- 

up 

Right 

1 

1 

9 

90 

m 

«» 

Right 

1 

1 

10 

0 

m 

as 

1 

1 

11 

135 

Left 

Down  Right 

1 

1 

r-16 

Total 

15 

29 

32 

36 

112 

Grand 

Total 

16 

44 

B 

65 

184 

1 

Mote.  Dash  indicates  correct  response. 
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Tabl«  16.  Rasponse  Errors  for  Targst  orientation  16 


PeBPOnae  error 


Aspect  Target  distance  fnni^ 

Target  Error  angle  Direction 

type  no.  (deg)  of  travel  Pitch  Bank  0.5  1.0  2.0  3.0  Total 


F-15 

1 

Right 

12 

12 

19 

13 

56 

2 

45 

• 

- 

3 

6 

8 

17 

3 

45 

- 

- 

Left 

1 

1 

.  4 

4 

10 

4 

90 

- 

- 

Right 

1 

2 

2 

2 

7 

5 

90 

- 

- 

Left 

2 

2 

6 

45 

tm 

- 

Right 

2 

2 

7 

- 

- 

- 

Left 

1  ' 

1 

2 

8 

- 

- 

- 

Level 

1 

1 

9 

45 

- 

Up 

Right 

1 

1 

10 

135 

Left 

•• 

1 

1 

r-15 

Total 

14 

18 

32 

35 

99 

F-16 

1 

45 

12 

16 

11 

8 

47 

2 

- 

- 

- 

Right 

6 

6 

9 

13 

34 

3 

45 

tm 

Left 

5 

12 

5 

4 

26 

4 

• 

- 

Left 

2 

4 

2 

8 

5 

45 

- 

«» 

Right 

2 

4 

6 

6 

135 

Left 

• 

• 

2 

1 

3 

7 

135 

Left 

Level 

Left 

3 

3 

8 

90 

- 

- 

Right 

2 

1 

3 

9 

90 

- 

Left 

1 

1 

1 

3 

10 

90 

- 

- 

- 

1 

2 

3 

11 

45 

Left 

- 

- 

1 

1 

12 

135 

- 

Level 

Right 

1 

1 

13 

- 

- 

Level 

- 

1 

1 

P-16  Total 

28 

37 

35 

39 

139 

Grand  Total 

42 

55 

67 

74 

238 

Note.  Dash  indicates  correct  response 


APPENDIX  D 

DEBRIEFING  QUESTIONNAIRE  RESPONSES 
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old  the  target  images  appear  realistic? 


Resp'onse 

Total 

"Yes" 

72 

"No" 

7 

No  response 

1 

Explanations  for  the  "No"  responses: 


Frequency  Explanation 


2  No  target  movement. 

2  Target  features  were  not  distinct  enough. 

1  No  glint  or  glare  from  natural  lighting. 

1  Too  much  detail.  Too  clear. 

1  Never  have  seen  a  full  missile  load.  No 

detail  is  normally  present  on  F-15  belly. 


Did  the  simulated  target  distances  appear  realistic? 


Response 

Total 

"Yes" 

77 

"No" 

2 

No  response 

1 

Explanations  for  the  "No"  responses: 


Frequency 

Explanation 

1 

The  0.5  nml  target  seemed  closer.  The  other 
distances  were  realistic. 

1 

No  reason  given. 

Here  any  cues  missing  that  you  normally  use  to  determine 
target  orientation? 


Response 

Total 

"Yes" 

40 

"No* 

39 

No  response 

1 

Explanations  for  the  ''Yes"  responses: 


Frequency  Explanation 


16 

1 

1 

1 

1 

2 

3 

1 

1 

1 

1 

1 

1 

1 

1 

1. 

2 

1 

1 

1 


No  target  motion. 

No  target  motion  or  canopy  glare. 

No  target  movement  or  shadows. 

No  target  line-of-sight  rates. 

No  horizon,  clouds,  atmospheric  conditions,  or 
target  contrails. 

No  target  smoke  trail. 

No  target  color  shading  and/or  shadows. 

No  target  wingtlp  vortices. 

No  target  canopy  flashes  or  refueling 
markings. 

No  target  motion,  smoke  trails,  etc. 

No  target  smoke  trails  or  sun  glint. 

No  target  line~of~sight  rates,  turn  cues, 
situational  awareness,  etc. 

No  target  external  centerline  fuel  tank. 

No  situational  awareness. 

No  glare  from  the  target  canopy  or  off  the 
tall. 

No  target  motion,  situational  awareness, 
horizon,  etc. 

No  exhaust  smoke  or  contrails. 

No  shiny  exhaust  outlets. 

No  target  motion  or  line-of-slght  rates. 

No  head-up  display  (HUD)  aspect  angle 
indicator. 

No  target  vapor  trails  at  high  angle  of  attack. 


1 


How  does  this  task  compare  to  actual  target  orientation 
assessment? 


Response 

Total 

"Easier" 

8 

"About  the  same" 

15 

"More  difficult" 

57 

Explanations  for  the  "Easier"  responses: 


Frequency 

Explanation 

1 

Viewing  distance  to  the  targets  was  constant. 

3 

Location  of  the  targets  was  constant. 

1 

Targets  were  clearer. 

1 

Location  of  the  targets  was  predictable  and  no 
workload  from  flying  own  aircraft. 

1 

Missiles  on  the  targets  were  white.  Have  seen 
only  gray-colored  missiles. 

1 

Learned  to  look  for  certain  visual  cues. 
Aircraft  motion  in  the  real  world  does  not 
allow  time  for  extended  looking. 

Explanations 

for  the  "more  difficult"  responses: 

Frequency 

Explanation 

29  No  target  motion  cues. 

2  No  target  motion  cues  and  the  coloring  was 

difficult  to  distinguish. 

2  No  target  motion,  rate  of  change  information 
exhaust  trails,  or  previous  position. 

1  No  target  smoke  trail  or  previous  position. 

3  No  target  motion  or  line-of-sight  rate. 

2  No  target  motion,  line-of-sight  rate,  or 
contrast  with  the  terrain  or  atmospheric 
conditions . 

3  No  line-of-sight  rate. 

2  No  target  motion  or  glare. 

1  No  target  motion  or  radar  information. 

2  No  situational  awareness. 
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2 

2 

1 

1 

1 

1 

1 

1 


No  target  motion  or  situational  awareness. 

No  target  motion  or  previous  position. 

No  line-of -sight  rate  or  previous  position. 

No  target  motion  or  horizon. 

Target  visual  cues  are  normally  more  distinct. 
No  target  motion,  smoke  trail,  vapor  trail,  or 
afterburner  light. 

No  developing  trend  of  target  position. 

No  target  motion,  line-of-sight  rates,  or 
rolling  motion. 


5.  Did  the  target  background  appear  realistic? 


Response 

Total 

"Yes" 

53 

"No" 

27 

Explanations  for  the  "No" 

responses : 

Frequency  Explanation 


19  The  background  was  always  the  same.  Sometimes 

dark  blue  sky,  clouds,  and  ground  are  visible. 

1  No  target  smoke  trail. 

3  The  background  was  too  bright. 

2  No  horizon,  clouds,  or  atmospheric  conditions. 

2  No  reason  given. 


6.  Here  the  targets  obscured  or  degraded  in  any  way? 


Response 

Total 

"Yes" 

4 

"No" 

76 
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Explanations  for  the  "Yes"  responses: 


Frequency 


Explanation 


1 

2 

1 


Some  targets  appeared  fuzzier  than  others. 
Increased  simulated  distance  reduced  cue 
clarity. 

Tiiere  were  some  scratches  and  specks  on  the 
slides  but  they  didn't  affect  the  target 
Images . 


7. 


8. 


Were  there  any  outside  distractions  during  the  slide 
presentations? 


Response  Total 


"Yes"  0 

"No"  80 


Explanations  for  the  "Yes"  responses:  Not  applicable. 


Were  you  able  to  predict  the  orientation  of  the  target  at  any 
time? 


Response  Total 


"Yes"  0 

"No"  80 


Explanations  for  the  "Yes"  responses:  Nor  applicable. 
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Were  there  any  cues  in  the  slides,  other  than  the  target,  that 
indicated  the  target  orientation? 


Explanation  for  the  "Too  long"  responses: 


Frequency 


Explanation 


1  Pilots  would  see  the  motion  of  the  target  in 

real  flight  at  this  target  duration. 

1  Too  long  when  a  lot  of  time  Is  spent  on 

listing  the  cues  used. 


11.  Did  you  experience  any  fatigue  during  the  slide  presentations? 


Response 

Total 

"Yes" 

9 

"No" 

71 

Explanation  for  the  "Yes"  responses: 


Frequency 

Explanation 

C 

Some  eye  fatigve. 

2 

Got  a  little  tired  toward  end  of  session. 

1 

Looking  from  slide  to  paper  and  back  was 

tiring. 

1 

No  reason  given. 
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